Professional Documents
Culture Documents
Forrester Total Economic Impact of Amplitude
Forrester Total Economic Impact of Amplitude
Of Amplitude
Cost Savings And Business Benefits
Enabled By Amplitude
AUGUST 2023
z
Time savings related to product
$873.7K
development and management work
Operational efficiency
Time savings in addressing ad hoc
$151.4K
requests from other teams
& Cost savings
COMPOSITE ORGANIZATION
Designed a composite organization based on
characteristics of the interviewees’
organizations.
Interviews
Estimated
Role Industry Region Annual revenue number of active
users
Chief architect Social media North America Less than $10M Less than 10M
Director of product
Healthcare North America $5B to $10B Less than 10M
management
insights generated. The chief product officer at an and depth. The chief architect at a social media
entertainment organization shared: “There was a company said: “Amplitude was able to give us
tool implemented, but nobody trusted [it]. The more sophisticated, automated analysis [about
[measurement] features were not relevant. So, user behavior]. So, [Amplitude was] not just
there was nothing done [with] the metrics and taking a set of events, counting them, or splitting
analytics generated from the tool.” them on some dimensions. … [It was] also able
to have some predictive insights about what
• Operational inefficiency. Some interviewees
might be most relevant to our business.”
said their organization tried working out a
process to analyze its product usage on its own The same chief architect added: “Amplitude is
but that they quickly found the effort to be highly our primary source of both user segmentation
inefficient. The chief product officer at an and event data. We run campaigns that are
entertainment company shared: “People were targeted at a segment of users, and triggered by
randomly tagging applications without a coherent events that happen in the system. We use
strategy. I remember people trying for weeks to Amplitude’s Customer Data Platform (CDP) to
generate some KPI on graph, but [they] found synchronize cohorts for targeting segments and
they needed to double check and triple check to stream events for campaign triggering. We can
everything.” then get events reported back to Amplitude for
the users who receive campaigns.”
data-oriented in our did the data ingestion to the time we had the
analysis. With Amplitude, it was basically instant.”
understanding of how people
use our product.” • Be accessible to different people, roles, and
business units. Interviewees shared that their
Chief architect, social media organizations were also looking for a tool with a
self-service element to allow different people
across the business to access the tool and
extract the information or insights they need. A
INVESTMENT OBJECTIVES software engineer from a consumer application
The interviewees’ organizations searched for a company noted: “The name of the game right
solution that could: now is self-serve. If we want to keep up with
competitors, we need to keep up in terms of how
• Produce quality and in-depth analysis.
fast we can gain insights. To do that, we cannot
Interviewees said their organizations were
be waiting on data engineers and analysts to be
looking for a solution that could produce a higher-
performing ad hoc analysis.”
level user behavior analysis in terms of quality
COMPOSITE ORGANIZATION
Based on the interviews, Forrester constructed a TEI
framework, a composite company, and an ROI
analysis that illustrates the areas financially affected. Key Assumptions
The composite organization is representative of the
• 10 million monthly
four interviewees, and it is used to present the
aggregate financial analysis in the next section. The
active users
composite organization has the following • 50 employees involved
characteristics:
in product analytics and
Description of composite. The composite experimentation
organization is a retail organization that’s trying to
improve its digital presence from its legacy brick and • Moves from a variety of
mortar environment. It has 10 million monthly active disparate solutions to
users (MAUs) in the consumer application on which it Amplitude
plans to implement Amplitude. The consumer
application drives revenue to the composite
organization in two ways: 1) paying users pay a
recurring subscription fee, and 2) the organization
receives indirect revenue from third-party advertising
based on the application’s total paying and
nonpaying users.
Total Benefits
Present
Ref. Benefit Year 1 Year 2 Year 3 Total
Value
Incremental profit growth from
Atr $510,000 $765,000 $918,000 $2,193,000 $1,785,575
user growth
Incremental profit growth from
Btr better monetization of existing $544,000 $856,800 $1,224,000 $2,624,800 $2,122,254
customer base
Revenue retention from
Ctr $461,693 $525,178 $605,975 $1,592,846 $1,309,030
preventing customer churn
Time savings related to
Dtr product development and $144,500 $307,063 $650,250 $1,101,813 $873,677
management work
Time savings in addressing
Etr ad hoc requests from other $47,520 $61,776 $76,032 $185,328 $151,379
teams
Cost savings related to tech
Ftr $369,000 $759,870 $782,396 $1,911,266 $1,551,272
stack
■ INCREMENTAL PROFIT GROWTH FROM USER to see things in Amplitude [as they happen]
GROWTH makes a huge difference.”
Evidence and data. Interviewees noted that using • The director of product management at a
Amplitude gave their teams and organizations the healthcare organization shared: “With Amplitude,
ability to see how their customers were using their we looked at the amount of people who weren’t
offerings and which features or product
characteristics resonated with users. As a result, they
were able to experiment and introduce new
capabilities that could attract new people to use their
“Amplitude is our exclusive tool
offerings.
we use to measure our progress,
• The chief architect at a social media company
test changes experimentally, and
noted: “The more impactful story is the free user
understand our users’ behavior
growth cycle. We are an application where the
word of one person brings another to the
in order to design the next round
platform. That’s how we acquire users. This can of improvement.”
get very complicated very fast with a lot of
Chief architect, social media
multidimensional impacts. Having the level of
control that we have over our data and being able
paying their bills [and found] that we had made Risks. The exact benefit realized by an organization
bill pay a separate login. After making it easier to can vary, depending on factors such as:
pay bills on our app, we [saw] 90% of new users
• The size of the organization and its number of
coming through the application.
customers or users.
Modeling and assumptions. For the purposes of
• The organization’s industry, market, and
the composite organization, Forrester assumes:
competitive landscape, which can impact the
• The organization has 10 million MAUs. ease of acquiring new customers.
• With the insights generated from analytics and • The organization’s industry and geographic
experimentation introduced by Amplitude, the location, which can impact the expected revenue
organization grows its user base by 5% in Year 1, per customer/user and net margin.
by 7.5% in Year 2, and by 9% in Year 3.
Results. To account for these risks, Forrester
• The average revenue per user (ARPU) is $15 per adjusted this benefit downward by 15%, yielding a
year.3 three-year, risk-adjusted total PV of $1.8 million.
■ INCREMENTAL PROFIT GROWTH FROM • Prior to using Amplitude, 2% of this user base
BETTER MONETIZATION OF EXISTING converted into paying users per year.
CUSTOMER BASE
• With Amplitude, this conversion rate improves by
Evidence and data. Similar to the user growth 20% in Year 1, by 30% in Year 2, and by 40% in
benefit, interviewees also said their organizations Year 3.
used the analytics and experimentation from
Amplitude to explore ways to provide more value to • The composite’s average revenue per paying
their existing customer and user bases. As a result, user (ARPPU) is $200 per year.4
they were able to create better monetization • The composite’s net margin is 8%.
strategies. For digital application users, this could be
in the form of shifting free to paying users or
optimizing path to purchase. For more traditional
businesses, this could be about upsell and cross-sell “Being able to do advanced
levers with behavioral insights to maximize ARPUs
things like slicing down
and average order values. All of the resulting insights
segments, adjusting data sets
generated through Amplitude allowed the
organizations to better understand their existing after the fact, [and] using
customer bases. underlying analytics data rather
than an entirely different data set
• The director of product management at a
healthcare company said: “With Amplitude, we
[is useful]. [With Amplitude,] we
were able to look at specific user segments, have so much volume [of data to
[conduct] an A/B test, and find that with the new analyze].”
feature we introduced, our new version
performed 39% better than our old version.”
Director of product management,
healthcare
• The software engineer at a consumer application
added: “A lot of focus currently is on increasing
paid users via subscription or microtransactions.
The experiments [that we do on Amplitude] tell us Risks. The exact benefit realized by an organization
in real time what the expectations would be if we can vary, depending on factors such as:
launched this product or that feature to the
• The size of the organization and its number of
broader audience.”
customers or users.
• The chief product officer at an entertainment
• The organization’s industry, market, and
company noted: “With Amplitude, we were able
competitive landscape, which can impact the
to triple our conversion rate of people becoming
decision-making process of target customers to
paid consumers. By being able to focus on how
purchase additional offerings.
people discover our content, we have been able
to improve engagement and conversion.” • The organization’s industry and geographic
location, which can impact the expected revenue
Modeling and assumptions. For the purpose of the
per customer/user and net margin.
composite organization, Forrester assumes:
■ REVENUE RETENTION FROM PREVENTING through a few iterations of these features. The
CUSTOMER CHURN few first attempts didn’t improve the overall usage
metrics as we hoped. Running the experiment
Evidence and data. The third area in which
through Amplitude allowed us to dive deeply into
interviewees noted their organizations are conducting
the behavior of the two cohorts to understand
insights and experimentation with Amplitude is to
why our first attempt didn’t work.”
understand how best to keep customers and users
from leaving (e.g., improving retention rate, reducing • The chief product officer at an entertainment
churn). Interviewees said using features on the company said: “In terms of engagement, we have
Amplitude platform such as behavioral cohorts to improved by 15% [due to Amplitude]. With
group users who share similar traits or characteristics Amplitude, we can focus on how people discover
gave them the ability to better engage with their content, improve features, and track user-
users. renewal rates.”
• The chief architect at a social media company • The software engineer at a consumer application
noted: “We’ve run a number of tests in the organization added: “[With Amplitude,] we can
retention or churn-prevention category. We have see where exactly users are dropping off in their
been adding features to allow people to connect journey and experience of using our app.”
with each other more easily. We had to go
Modeling and assumptions. For the purpose of the • The size of the organization and its number of
composite organization, Forrester assumes: customers or users.
• The composite’s number of paying users per year • The organization’s industry, market, and
is based on its conversion rate with Amplitude. competitive landscape, which can impact the
benchmark customer churn rate and the
• Prior to using Amplitude, 94.3% of the paying
percentage improvement Amplitude can
users dropped off within the first 30 days of
introduce.
converting from being a free user to becoming a
paying user.5 • The organization’s industry and geographic
location, which can also impact the expected
• With Amplitude, this churn rate reduces by 15%
revenue per customer/user and net margin.
each year.
Results. To account for these risks, Forrester
• The composite’s average revenue per paying
adjusted this benefit downward by 15%, yielding a
user (ARPPU) is $200 per year.6
three-year, risk-adjusted total PV of $1.3 million.
• The composite’s net margin is 8%.
■ TIME SAVINGS RELATED TO PRODUCT • The chief architect at a social media company
DEVELOPMENT AND MANAGEMENT WORK said: “Thinking about productivity in experiments
Evidence and data. As noted previously, per year and how rapidly we can build, deploy,
interviewees shared that prior to using Amplitude, read, [and] iterate on that cycle, ideally, we would
their organizations’ use of analytics and complete this cycle every week. That would be
experimentation of product usage or new features 12 iterations per quarter. Without Amplitude, we
was highly inefficient. Similarly, trying to target [could] only do one or two iterations per quarter.”
specific user groups to help build specific marketing • The chief product officer at an entertainment firm
campaigns was too time-consuming. This became an noted: “My product analytics team can now do
issue because it limited what the organizations could things that if they had to do it in the previous
do to improve their offerings and grow their business. environment, it would have taken a lot of time.
According to Forrester’s Data and Analytics Survey, For our data scientists and engineers who know
2022, 80% of data and analytics decision-makers how to use the tool, [Amplitude] saves a lot of
said their organization used or planned to use A/B time.”
and multivariate testing in the following 12 months.7
• The software engineer at a consumer application
To identify and deliver the next best experience on a
consistent basis, brands need to run multivariate company added: “[Previously,] our data scientists
tests on a massive scale. were doing statistical significance calculations
manually. The ability of Amplitude to almost real-
Interviewees said that by moving to Amplitude, their time calculate that and … recommend actions
organizations could quickly set up this work through [out of the box] based on those outputs is
the platform, natively integrate with analytics, and tremendously helpful. At the moment, we only do
insights are generated instantaneously. Having a one experiment a month, but we expect to be
consolidated platform for analytics, customer data able to do 10 to 20 experiments a month by end
management, data activation, and experimentation of year.”
led to time savings for data scientists and engineers.
As a result, interviewees noted that data engineers Modeling and assumptions. For the purpose of the
and scientists became much more productive in their composite organization, Forrester assumes:
work to understand ways to improve products and • There are 50 employees involved in product
offerings. management, analytics, and experimentation
work.
•
Time savings in Taking into account user training and change
management that needs to be done to get these
experimentation and
employees to fully convert to Amplitude, the
analytics work per year
percentage of work impacted by this tool is 5% in
Year 1, 10% in Year 2, and 20% in Year 3.
• Taking into account the different roles, seniority, • The organization’s change management and
and level of involvement in this work, the average user training.
fully burdened annual salary of an employee
• The organization’s industry and geographic
involved is $170,000.8
location, which can impact the fully burdened
• The composite’s productivity recapture from the annual salaries of employees.
realized time savings is 50%. This is the
• The skills and capabilities of the organization’s
percentage of time they can dedicate to
employees, which can impact the roles and
additional effort, work, and activities as a result of
seniority of people who need to be involved in
the time savings.
this work.
Risks. The exact benefit realized by an organization
Results. To account for these risks, Forrester
can vary, depending on factors such as:
adjusted this benefit downward by 15%, yielding a
• The adoption rate of the organization’s product three-year, risk-adjusted total PV of $873,700
management, analytics, and experimentation
teams and how quickly they are willing to shift to
using Amplitude.
■ TIME SAVINGS IN ADDRESSING AD HOC • The composite’s data scientists and engineers
REQUESTS FROM OTHER TEAMS receive an average of 600 ad hoc requests from
Evidence and data. Interviewees noted that the self- other business units per year.
service aspect of Amplitude enabled team members • The average amount of time needed to complete
from different units to access the platform and gather each request is 2 hours.
the information or insights needed. Prior to using
Amplitude, these team members would need to ask • With Amplitude, the composite realizes time
for this information in the form of ad hoc requests to savings of 50% in Year 1, 65% in Year 2, and
data scientists, engineers, product managers, and 80% in Year 3.
leaders. The exact requests could vary in type and • The fully burdened hourly salaries of data
complexity, but they almost always took time away scientists and engineers is $88.
from the person’s core work and responsibility. But
Risks. The exact benefit realized by an organization
interviewees said that with Amplitude, a team
can vary, depending on factors such as:
member making the request can access that data on
the platform themselves. This reduces the backlog of • The type and complexity of the request, which
ad hoc requests that is created and, as a result, data impacts how long it will take to address each
scientists and engineers can recapture that time and request and the percentage that can be
focus on more strategic and complex activities. addressed with self-service.
• The chief architect at a social media company • The workload the organization’s data scientists
noted: “Doing ad hoc analysis based on what and engineers currently handle at the time of
product managers or marketing people were request and the amount of time they can take to
asking with Amplitude is faster. Thinking about address the ad hoc request.
the time we spend addressing those requests, we
• The criticality of the request to the overall
are now able to do that 50% faster. This is
success of the business.
because it’s easier to do funnel analysis and
segmentation with Amplitude.” Results. To account for these risks, Forrester
adjusted this benefit downward by 10%, yielding a
• The software engineer at a consumer application
three-year, risk-adjusted total PV of $151,400.
added: “For behavioral analytics, a lot of that
analysis had to be done by data analysts and
engineers. We would create ad hoc reports
based on what product managers or marketing
[teams] were asking. With Amplitude, we can
make 70% to 80% of those requests self-serve,
which would free up data analysts and data
engineers to do things that are more interesting,
more value-add, and just overall free up time for
those teams to move faster.”
■ COST SAVINGS RELATED TO TECH STACK Finally, some interviewees also noted their
organization saved in the form of labor it would have
Evidence and data. Interviewees noted that by
had to hire if it didn’t use Amplitude.
moving to Amplitude, their organizations realized cost
savings to their tech stacks. The chief architect at the social media company
shared, “If I didn’t have Amplitude, I would imagine I
Many interviewees said cost savings are simply the
would have needed 10% more people on my data
result of being able to discontinue their company’s
and engineering team to do analytics and
spend on the license fee for its legacy platform.
experimentation.”
Others said the cost savings came in form of vendor
consolidation and that Amplitude’s features allow Modeling and assumptions. For the purpose of the
their organization to no longer need to work with composite organization, Forrester assumes:
multiple vendors because Amplitude has multiple
• The composite retires its legacy solution and
capabilities.
saves on the effort required to maintain the
• The chief product officer at an entertainment solution.
company said, “Without Amplitude, we probably
• The annual cost of the composite’s legacy tech
would have to spend another 20% to 25% on our
stack totals $810,000 in Year 1, and this
analysis tooling budget.”
increases by 3% each year. This total is
• The director of product management at a calculated from the spend for the legacy analytics
healthcare company noted, “If we used a products, which cost the same as the annual cost
separate vendor for experimentation, that would of Amplitude.
[cost] 50% to 100% more on top of what we pay
for Amplitude.”
• The composite saves an additional 20% by Risks. The exact benefit realized by an organization
retiring other tools and avoiding spend that can can vary, depending on factors such as:
be avoided with Amplitude.
• The complexity of the organization’s legacy
• The composite tasks one product analyst with environment and the functionality that can be
dedicating 10% of their time to maintaining its replaced with Amplitude.
legacy solutions.
• The organization’s industry and geographic
• The fully burdened annual salary of the product location, which can impact the fully burdened
analyst is $100,000. annual salaries of employees.
• By moving to Amplitude, the organization Results. To account for these risks, Forrester
reduces 50% of its annual legacy cost in Year 1 adjusted this benefit downward by 10%, yielding a
and 100% of the annual legacy cost in years 2 three-year, risk-adjusted total PV of $1.6 million.
and 3.
Total Costs
Present
Ref. Cost Initial Year 1 Year 2 Year 3 Total
Value
Gtr Software license fees $0 $708,750 $730,013 $751,913 $2,190,675 $1,812,558
Modeling and assumptions. For the purpose of the • The amount of data and information to be
composite organization, Forrester assumes: analyzed.
• The composite pays Amplitude $675,000 for its • The exact features the organization implements
licensing fee in Year 1, and this increases by 3% with the Amplitude platform.
each year. Results. To account for these risks, Forrester
• Pricing may vary. Contact Amplitude for adjusted this cost upward by 5%, yielding a three-
additional details. year, risk-adjusted total PV of $1.8 million.
INTERNAL LABOR COSTS RELATED TO • Once the platform is set up, the organization
SETTING UP AMPLITUDE AND USER TRAINING trains 20 employees with a more streamlined, 2-
hour user-training session each year.
Evidence and data. Interviewees noted that setting
up Amplitude at their organizations required Risks. The exact cost and time invested by an
involvement from different team members. The organization can vary, depending on factors such as:
process typically started by evaluating the needs and
• The complexity of the organization’s product
use cases of Amplitude at their organizations. Once
analytics and experimentation environment.
that was decided, the companies needed to migrate
data, set up governance processes, and start training • The expectations about which capabilities and
users. functionalities need to be set up immediately as
opposed to progressively over time.
• The engineer at a social media company shared,
“Most of the initial time was spent for evaluation. • The organization’s industry and geography,
There were two to three of us at the time [who which can impact the assumed fully burdened
were] involved in the process.” annual salaries of employees.
• The chief product officer at an entertainment firm Results. To account for these risks, Forrester
said: “POC [proof of concept] was three months. adjusted this cost upward by 10%, yielding a three-
Once we proved the value, it took another three year, risk-adjusted total PV of $480,000.
months to deploy the solution to other parts of the
organization.”
H8 Fully burdened hourly salary of a user TEI standard $82 $82 $82 $82
INTERNAL LABOR COSTS RELATED TO • The chief product officer at an entertainment firm
ONGOING MANAGEMENT OF AMPLITUDE added: “We have someone on my team in charge
of the management of Amplitude. Anytime we
Evidence and data. Interviewees said that once their
have an issue or have a question, that is the
organizations set up Amplitude, they dedicated
person we call. We also have another person
employees to do ongoing management activities.
responsible for checking that everything is
This could include building and adding features,
working fine.”
handling ticket requests, or being involved in
recurring touchpoints with the Amplitude team on • The director of product management in
how best to take advantage of the platform. healthcare told Forrester: “We made sure that
each team had one person who knew how to do
• The engineer at a social media company shared:
analytics tickets. We’re building features,
“There are two people who occasionally go
handling tickets, [and] everything.”
through and do data hygiene work. They spend
about 10% of their time [on this], which I think Modeling and assumptions. For the purpose of the
they should be doing a lot more.” composite organization, Forrester assumes that:
• Two employees dedicate 30% of their time to • The skill set, knowledge, and capabilities of the
ongoing management of Amplitude. organization’s employees.
• The fully burdened annual salary of an involved • The organization’s industry and geography,
employee is $100,000. which can impact the assumed fully burdened
annual salaries of employees.
Risks. The exact cost and time invested by an
organization can vary, depending on factors such as: Results. To account for these risks, Forrester
adjusted this cost upward by 10%, yielding a three-
• The complexity of the organization’s product
year, risk-adjusted total PV of $164,100.
analytics and the environment work being
conducted.
Total costs Total benefits Cumulative net benefits The financial results calculated in the
Benefits and Costs sections can be
used to determine the ROI, NPV, and
$8.0 M
Cash
flows
$5.0 M
$4.0 M
-$2.0 M
Initial Year 1 Year 2 Year 3
ROI 217%
Costs consider all expenses necessary to deliver the RETURN ON INVESTMENT (ROI)
proposed value, or benefits, of the product. The cost
category within TEI captures incremental costs over A project’s expected return in
the existing environment for ongoing costs percentage terms. ROI is calculated by
associated with the solution. dividing net benefits (benefits less costs)
by costs.
Flexibility represents the strategic value that can be
obtained for some future additional investment
building on top of the initial investment already made. DISCOUNT RATE
Having the ability to capture that benefit has a PV
that can be estimated. The interest rate used in cash flow
analysis to take into account the
Risks measure the uncertainty of benefit and cost time value of money. Organizations
estimates given: 1) the likelihood that estimates will typically use discount rates between
meet original projections and 2) the likelihood that 8% and 16%.
estimates will be tracked over time. TEI risk factors
are based on “triangular distribution.”
PAYBACK PERIOD
The initial investment column contains costs incurred at “time
The breakeven point for an investment.
0” or at the beginning of Year 1 that are not discounted. All
other cash flows are discounted using the discount rate at the This is the point in time at which net
end of the year. PV calculations are calculated for each total benefits (benefits minus costs) equal
cost and benefit estimate. NPV calculations in the summary initial investment or cost.
tables are the sum of the initial investment and the
discounted cash flows in each year. Sums and present value
calculations of the Total Benefits, Total Costs, and Cash Flow
tables may not exactly add up, as some rounding may occur.
“Now Tech: Journey Management Platforms, Q4 2021,” Forrester Research, Inc., December 21, 2021
“The Business Impact Of Digital Experience Technology Is Profitable Growth,” Forrester Research, Inc., March 1,
2021
Appendix C: Endnotes
1 Total Economic Impact is a methodology developed by Forrester Research that enhances a company’s
technology decision-making processes and assists vendors in communicating the value proposition of their
products and services to clients. The TEI methodology helps companies demonstrate, justify, and realize the
tangible value of IT initiatives to both senior management and other key business stakeholders.
2 Source: “The State Of The Insights-Driven Business, 2022,” Forrester Research, Inc., August 24, 2022.
3Average revenue per user (ARPU) is the amount of money an application generates from all users and revenue
streams for the application. Source: “Fundamentals Of Financial Forecasting Guide,” Wall Street Prep.
4 Ibid.
5The average retention rate across 31 categories by Day 30 is 5.7%. Source: “Mobile Growth Basics: User
Retention,” Mobile Growth Association, January 9, 2023.
6Average revenue per paying user (ARPPU) is the amount of money an application can expect to generate from its
paying users over a set period of time, excluding nonpaying users and revenue gained from sources other than
paying users. Source: “Fundamentals Of Financial Forecasting Guide,” Wall Street Prep.
7Source: “The Future Of Customer Insights Will Power Next Best Experiences,” Forrester Research, Inc., March
15, 2023.
8 Fully burdened salary includes both the direct wages and indirect costs of hiring and employment. Burden rate
refers to indirect costs of employment beyond direct compensation that are including but not limited to hiring costs,
training costs, financial services, paid time off, sick leave, expenses, retirement contributions, payroll taxes,
incremental technology, and workplace costs for the employee.
9 Source: “The State Of The Insights-Driven Business, 2022”, Forrester Research, Inc., August 24, 2022.