Download as pdf or txt
Download as pdf or txt
You are on page 1of 18

LICENSED FOR INDIVIDUAL USE ONLY

The Forrester New Wave™: Standalone Chatbots


For IT Operations, Q2 2019
The Eight Providers That Matter Most And How They Stack Up

by Charles Betz and Will McKeon-White


April 15, 2019

Why Read This Report Key Takeaways


In Forrester’s evaluation of the emerging market IPsoft, Serviceaide, And Avaamo Lead The
for standalone chatbots for IT operations, we Pack
identified the eight most significant providers in Forrester’s research uncovered a market in which
the category — Avaamo, Botpress, EdgeVerve IPsoft, Serviceaide, and Avaamo are Leaders;
(Infosys), Inbenta Technologies, IPsoft, Kore.ai, EdgeVerve and Kore.ai are Strong Performers;
Serviceaide, and SnatchBot — and evaluated Botpress and Inbenta Technologies are
them. This report details our findings about Contenders; and SnatchBot is a Challenger.
how well each vendor scored against 10 criteria
Chatbot Readiness And Predefined
and where they stand in relation to each other.
Integrations Are Key Differentiators
Infrastructure and operations (I&O) professionals
Forrester found that out-of-the-box (OOB)
can use this review to select the right partner for
workflows, language, intent models, and
their IT ops chatbot needs.
integrations dedicated to IT operations use cases
are key differentiators for Leaders in this space.
Advanced capabilities such as uncertainty scoring,
proactive improvement guidance, and active
pathing proved consistent among the strongest
performers in language development, which is
crucial for successful IT operations use cases.

This PDF is only licensed for individual use when downloaded from forrester.com or reprints.forrester.com. All other distribution prohibited.
FORRESTER.COM
FOR INFRASTRUCTURE & OPERATIONS PROFESSIONALS

The Forrester New Wave™: Standalone Chatbots For IT Operations,


Q2 2019
The Eight Providers That Matter Most And How They Stack Up

by Charles Betz and Will McKeon-White


with Sandy Rogers, Ian Jacobs, J. P. Gownder, Craig Le Clair, Julia Caldwell, and Diane Lynch
April 15, 2019

Table Of Contents Related Research Documents


2 Standalone Chatbots For IT Operations Cracking The Collaboration Conundrum:
Automate The Easy Stuff Accelerate Customer Focus With ChatOps

2 Standalone Chatbots For IT Operations Get Control Over Your Bots With Forrester’s
Evaluation Overview Automation Framework

6 Vendor QuickCards Now Tech: Chatbots For IT Operations, Q1 2019

15 Supplemental Material

Share reports with colleagues.


Enhance your membership with
Research Share.

Forrester Research, Inc., 60 Acorn Park Drive, Cambridge, MA 02140 USA


+1 617-613-6000 | Fax: +1 617-613-5000 | forrester.com
© 2019 Forrester Research, Inc. Opinions reflect judgment at the time and are subject to change. Forrester®,
Technographics®, Forrester Wave, TechRadar, and Total Economic Impact are trademarks of Forrester Research,
Inc. All other trademarks are the property of their respective companies. Unauthorized copying or distributing
is a violation of copyright law. Citations@forrester.com or +1 866-367-7378
FOR INFRASTRUCTURE & OPERATIONS PROFESSIONALS April 15, 2019
The Forrester New Wave™: Standalone Chatbots For IT Operations, Q2 2019
The Eight Providers That Matter Most And How They Stack Up

Standalone Chatbots For IT Operations Automate The Easy Stuff


Chatbots augment IT help desk and operations activities by automating repeatable tasks and providing
self-service facilities for both employees and operations personnel. Ticket deflection, faster resolution
to issues, and improved user experience are just a few benefits that organizations can realize from
effective chatbot implementations. Whether they’re pulling information from a knowledge base, fulfilling
a password reset, or automating the provisioning of an environment, chatbots relieve IT staff members
from mundane tasks and allow them to focus on activities that add more value.

Vendors from varied backgrounds are offering chatbot solutions for IT operations in three major
forms: chatbot toolboxes, platform-specific chatbots, and virtual agents.1 Most of these solutions
currently require some degree of manual development for chatbot language models, intent, entity, and
workflows.2 Leading vendors provide more domain-specific assets, such as prefabricated IT operations
workflows, and greater levels of intelligence, such as self-optimizing language training. Some vendors
are experimenting with actively pathing interactions for even more automated language and workflow
development.3 In the future, the process of setting up, training, and optimizing chatbots will be further
automated and simplified.

Standalone Chatbots For IT Operations Evaluation Overview


The Forrester New Wave™ differs from our traditional Forrester Wave™. In the Forrester New Wave
evaluation, we evaluate only emerging technologies, and we base our analysis on a 10-criterion model
and 2-hour briefing with each evaluated vendor. We group the 10 criteria into current offering and
strategy (see Figure 1). We also review market presence.

We included eight vendors in this assessment: Avaamo, Botpress, EdgeVerve (Infosys), Inbenta
Technologies, IPsoft, Kore.ai, Serviceaide, and SnatchBot (see Figure 2 and see Figure 3). Each of
these vendors has:

›› Common IT operations workflow support. Each vendor’s product provides a preconfigured


chatbot or virtual agent with common IT operations workflows (e.g., ticketing, tier 0 support,
knowledge-base navigation, and request automation) available out of the box.

›› Advanced language capabilities. The product has advanced chat capabilities such as natural
language processing (NLP) and natural language understanding (NLU) provided natively or through
integration with more than one external NLP/NLU engine out of the box.

›› Net-new chatbot creation. The product can create and customize a net-new chatbot
persona through tooling.

›› Chatbot development GUI. The product provides the capabilities to create and customize
complex workflows through GUI-based tooling.

© 2019 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law. 2
Citations@forrester.com or +1 866-367-7378
FOR INFRASTRUCTURE & OPERATIONS PROFESSIONALS April 15, 2019
The Forrester New Wave™: Standalone Chatbots For IT Operations, Q2 2019
The Eight Providers That Matter Most And How They Stack Up

›› Learning capabilities. The product has the capability to continuously learn and improve actions
through advanced analytics, machine learning, or AI.

›› English language support. The product provides English language support out of the box.

›› Active customers. The product has more than 10 active, paying customers using it for IT
operations and was generally available as of January 1, 2019.

© 2019 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law. 3
Citations@forrester.com or +1 866-367-7378
FOR INFRASTRUCTURE & OPERATIONS PROFESSIONALS April 15, 2019
The Forrester New Wave™: Standalone Chatbots For IT Operations, Q2 2019
The Eight Providers That Matter Most And How They Stack Up

FIGURE 1 Assessment Criteria

Criteria Platform evaluation details

Chatbot How well does the solution take advantage of advanced language capabilities
learning (NLU/NLP)? How are intent and language models trained, modified, and managed?
How are data sets imported? Does the chatbot make use of any predictive
capabilities?

Chatbot What tooling/workflow engine capabilities are provided natively or via integrations?
automation How are complex workflows supported? Can the chatbot be configured to take
action, independent of invocation? What automation partnerships does the vendor
have? How are these integrations handled?

Architecture What integration facilities are available in or for the product? How can users create
and integrations integrations? What API management tools are provided? How are connections into
other systems mapped? What prebuilt IT ops integrations are provided? What is the
technical architecture of the product?

Chatbot What predefined intent models and language sets are available? What
readiness domain-specific and general out-of-the box (OOB) workflows are provided, and how
are these modified? What degree of OOB understanding of IT ops requirements is
demonstrated thorough language, intent, and workflows?

Development How is chatbot development supported? What type of tooling is provided, and how
and tooling easy is it to use? How robust is the GUI provided? At what level of granularity can bot
functionality be modified? How does the solution facilitate the creation and
management of responses? How are data sets managed?

Deployment What solution deployment options are available? What administration efforts are
and security required? How are user permissions granted and managed? How is security and user
data privacy handled? How granular are personally identifiable information (PII)
protection tools? What is the vendor’s data handling and storage strategy?

Bot What does the solution provide in terms of bot operations and reporting? How are
management bots managed? Does it provide visibility into user journey? What is the process for
bot deployment? What optimization tools are available? Does reporting provide any
proactive optimization suggestions or capabilities?

Vendor How well does the product vision and strategy align for the standalone chatbots for
positioning IT operations market? How is the vendor positioning its product in relation to other
vendors? What differentiating capabilities is the solution or vendor offering?

Road map How well-defined are planned enhancements, and how effectively do they address
the standalone chatbots for IT operations market?

Market Is the company executing a successful go-to-market approach? Does the vendor
approach have a well-thought-out partner strategy?

© 2019 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law. 4
Citations@forrester.com or +1 866-367-7378
FOR INFRASTRUCTURE & OPERATIONS PROFESSIONALS April 15, 2019
The Forrester New Wave™: Standalone Chatbots For IT Operations, Q2 2019
The Eight Providers That Matter Most And How They Stack Up

FIGURE 2 Forrester New Wave™: Standalone Chatbots For IT Operations, Q2 2019

Standalone Chatbots For IT Operations


Q2 2019

Strong
Challengers Contenders Performers Leaders

Stronger
current
offering IPsoft

Serviceaide
Avaamo
EdgeVerve

Kore.ai

Inbenta Technologies

SnatchBot Botpress

Weaker
current
offering

Weaker strategy Stronger strategy

Market presence*

*Gray marker indicated incomplete vendor participation.

© 2019 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law. 5
Citations@forrester.com or +1 866-367-7378
FOR INFRASTRUCTURE & OPERATIONS PROFESSIONALS April 15, 2019
The Forrester New Wave™: Standalone Chatbots For IT Operations, Q2 2019
The Eight Providers That Matter Most And How They Stack Up

FIGURE 3 Vendor QuickCard Overview

ns

ity
in
io

ur
ol
at

c
to
n

se
gr
io

ng
s

nd
es

h
at

te
ng

en
nd

ni

ac
ta
m

in

in

tio
ni

em
ta

ro
to

ad

en
ar

re

si

pp
en
au

ag
re
le

ap
po
m
ct

ta
ym

an
op
ot

ot

ot

m
ite

or

ke
tb

tb

tb

tm
lo
el

d
nd
ch

ep
ha

ha

ha

oa

ar
ev
Company

Bo

Ve
Ar

M
C

R
IPsoft

Serviceaide

Avaamo

EdgeVerve

Kore.ai

Botpress

Inbenta Technologies

SnatchBot

Differentiated On par Needs improvement

Vendor QuickCards
Forrester evaluated eight vendors and ranked them against 10 criteria. Here’s our take on each.

© 2019 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law. 6
Citations@forrester.com or +1 866-367-7378
FOR INFRASTRUCTURE & OPERATIONS PROFESSIONALS April 15, 2019
The Forrester New Wave™: Standalone Chatbots For IT Operations, Q2 2019
The Eight Providers That Matter Most And How They Stack Up

IPsoft: Forrester’s Take

Our evaluation found that IPsoft (see Figure 4):

›› Leads the pack with robust IT operations chatbot features. With a library of granular prefabricated
IT operations workflows and language models, detailed reporting, an automation platform, and
extensive language training, IPsoft’s Amelia leads the market in IT operations readiness.

›› Needs to work on appealing to more than just large enterprises. Today, customers view IPsoft’s
Amelia is as a significant investment in money and resources. To address a broader market, the
firm should continue to work on simplifying cost and bot training requirements.

›› Is the best fit for enterprises looking to make a commitment to cognitive technology. With its
workflow automation and active language development features, IPsoft provides an ideal solution
for those looking for advanced functionalities such as creating workflows for more-sophisticated
help desk interactions.

IPsoft Customer Reference Summary

Overall, IPsoft’s customers are satisfied with the product and seek to continuously expand their use
cases. They noted that the product has significantly improved in usability over time.

FIGURE 4 IPsoft QuickCard

Wave position

IPsoft LEADER

Chatbot learning Deployment and security REFERENCE QUOTES


Chatbot automation Bot management
Architecture/integrations Vendor positioning “Adoption of our chatbot tool
has been surprisingly high
Chatbot readiness Road map [across user ages].”
Development and tooling Market approach
“All L1 support goes through
Amelia and is trained on a
Differentiated On par Needs improvement quarter of top calls.”

Products evaluated
Amelia

© 2019 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law. 7
Citations@forrester.com or +1 866-367-7378
FOR INFRASTRUCTURE & OPERATIONS PROFESSIONALS April 15, 2019
The Forrester New Wave™: Standalone Chatbots For IT Operations, Q2 2019
The Eight Providers That Matter Most And How They Stack Up

Serviceaide: Forrester’s Take

Our evaluation found that Serviceaide (see Figure 5):

›› Leads the pack with IT operations orientation. Due to Serviceaide’s heritage in IT operations, its
chatbot strategy and road map strongly align to supporting the needs of day-to-day IT operations,
including granular out-of-the-box IT ops workflows.

›› Needs to expand its visual development capabilities. Missing from the Serviceaide platform are
graphical relationship models, e.g., wireframe graphs. Introducing these features will further assist
developers in gaining an understanding of the user journey through the chat interface.

›› Is the best fit for organizations pursuing an augmented IT operations team. With its IT
operations specificity and easy-to-configure follow-up interactions, Serviceaide’s Luma provides an
attractive platform for augmenting IT service delivery capabilities.

Serviceaide Customer Reference Summary

Serviceaide customers are exceptionally pleased with their experiences, noting the solution’s fast time-
to-implementation and time-to-value, thanks to its out-of-the-box capabilities and workflows.

FIGURE 5 Serviceaide QuickCard

Wave position

Serviceaide LEADER

Chatbot learning Deployment and security REFERENCE QUOTES


Chatbot automation Bot management
Architecture/integrations Vendor positioning “An extra benefit has been, our
service desk staff can instantly
Chatbot readiness Road map find the status of a ticket.”
Development and tooling Market approach
“Their out-of-the-box language
and intent models met almost
Differentiated On par Needs improvement all our base needs.”

Products evaluated
Serviceaide Luma

© 2019 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law. 8
Citations@forrester.com or +1 866-367-7378
FOR INFRASTRUCTURE & OPERATIONS PROFESSIONALS April 15, 2019
The Forrester New Wave™: Standalone Chatbots For IT Operations, Q2 2019
The Eight Providers That Matter Most And How They Stack Up

Avaamo: Forrester’s Take

Our evaluation found that Avaamo (see Figure 6):

›› Provides robust integration and training capabilities. With prebuilt integrations, including legacy
solutions, Avaamo can address non-API-enabled environments. It also provides data-cleaning tools
model training, using unformatted data for added flexibility.

›› Needs to streamline elements of the development tool interface. While Avaamo provides a
GUI-based chatbot development environment, managing multiple language and workflow elements
is cumbersome and needs to better support designing multidirectional chatbot conversations.

›› Is best suited for multiple generations of IT systems. Through the platform’s capabilities relating
to training and integration, coupled with full security features, Avaamo provides an attractive option
for organizations with legacy IT elements.

Avaamo Customer Reference Summary

Avaamo’s customer references are enthusiastic about their implementations and look to further expand
their uses of the solution. They noted, however, that managing user expectations regarding the current
bot capabilities is critical.

FIGURE 6 Avaamo QuickCard

Wave position

Avaamo LEADER

Chatbot learning Deployment and security REFERENCE QUOTES


Chatbot automation Bot management
Architecture/integrations Vendor positioning “Integration was one of the
easiest parts of the
Chatbot readiness Road map implementation.”
Development and tooling Market approach
“Avaamo has been able to
provide the majority of features
Differentiated On par Needs improvement requested.”

Products evaluated
Avaamo Conversational AI Platform

© 2019 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law. 9
Citations@forrester.com or +1 866-367-7378
FOR INFRASTRUCTURE & OPERATIONS PROFESSIONALS April 15, 2019
The Forrester New Wave™: Standalone Chatbots For IT Operations, Q2 2019
The Eight Providers That Matter Most And How They Stack Up

EdgeVerve (Infosys): Forrester’s Take

Our evaluation found that EdgeVerve (see Figure 7):

›› Provides granular language model development tools and RPA coupling. EdgeVerve gives
users a powerful language model development and optimization tool set. Additionally, it natively
integrates with EdgeVerve’s own robotic process automation (RPA) platform, providing a versatile
automation suite.

›› Needs to better market its IT operations capabilities. EdgeVerve provided limited publicly
available information related to Nia and its capabilities in the context of Nia’s functionality for IT
operations. This may cause organizations to overlook the solution when developing their strategies.

›› Is the best fit for customers looking to expand EdgeVerve functionality. Through its
connectivity with the EdgeVerve RPA platform and flexible language models, Infosys’ Nia provides
users with a powerful and customizable automation package.

EdgeVerve Customer Reference Summary

EdgeVerve was a nonparticipating vendor, and Forrester was unable to speak with EdgeVerve
customers for this evaluation.

FIGURE 7 EdgeVerve QuickCard

Wave position

EdgeVerve STRONG PERFORMER

Chatbot learning Deployment and security REFERENCE QUOTES


Chatbot automation Bot management
Architecture/integrations Vendor positioning EdgeVerve did not participate
in this evaluation and chose
Chatbot readiness Road map not to provide references.
Development and tooling Market approach

Differentiated On par Needs improvement

Products evaluated
EdgeVerve NIA

© 2019 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law. 10
Citations@forrester.com or +1 866-367-7378
FOR INFRASTRUCTURE & OPERATIONS PROFESSIONALS April 15, 2019
The Forrester New Wave™: Standalone Chatbots For IT Operations, Q2 2019
The Eight Providers That Matter Most And How They Stack Up

Kore.ai: Forrester’s Take

Our evaluation found that Kore.ai (see Figure 8):

›› Provides superior language model visibility and control. Kore.ai provides one of the most
intuitive chatbot language management suites we evaluated. It provides a comprehensive intent
management portal, multicontextual conversation support, NLU decision-tree visibility and training,
and native data sanitation tools.

›› Needs to expand IT ops support. While the platform provides a prefabricated ITSM “smartbot,”
the solution assumes an IT environment accessible mostly through open APIs with already-defined
workflows to use as templates for automation beyond base capabilities.4

›› Is the best fit for companies that need a transparent language model. Supporting a variety of
general use cases and granular language learning visibility, Kore.ai provides a well-rounded solution
to pursue a department-agnostic chatbot strategy.

Kore.ai Customer Reference Summary

Kore.ai customer references reported overall satisfaction with their experiences and are looking to
expand their uses of the platform. They did note that their initiatives have taken longer than anticipated,
including some unexpected delays due to integration complexities.

FIGURE 8 Kore.ai QuickCard

Wave position

Kore.ai STRONG PERFORMER

Chatbot learning Deployment and security REFERENCE QUOTES


Chatbot automation Bot management
Architecture/integrations Vendor positioning “Today, we’re using the bot to
provide help desk Q&A and are
Chatbot readiness Road map looking to expand.”
Development and tooling Market approach
“A lot of people have been happy
with ease of the interface — it’s
Differentiated On par Needs improvement easy to train people.”

Products evaluated
Kore.ai Bots Platform

© 2019 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law. 11
Citations@forrester.com or +1 866-367-7378
FOR INFRASTRUCTURE & OPERATIONS PROFESSIONALS April 15, 2019
The Forrester New Wave™: Standalone Chatbots For IT Operations, Q2 2019
The Eight Providers That Matter Most And How They Stack Up

Botpress: Forrester’s Take

Our evaluation found that Botpress (see Figure 9):

›› Provides a developer-friendly platform. With its modular platform, code-level access to all
elements of a bot, insight into NLU decision making, and overall open source strategy, Botpress
provides developers with a comprehensive set of tools to rapidly develop a chatbot solution.

›› Needs to expand its out-of-the-box support for IT ops. Botpress currently provides a limited
set of prefabricated assets, in general, and requires more IT operations-centric workflows and
language models, a prerequisite for most organizations looking to rapidly implement a chatbot for
those purposes.

›› Is best suited for customers looking to pursue a developer-led chatbot strategy. With its
developer tools, open source community, and customizability, Botpress provides developers with
the materials they need to get a chatbot rapidly up and running.

Botpress Customer Reference Summary

Botpress’ customers are eager to expand their use of the tool but note that further prebuilt assets
would help them more readily expand beyond their initial implementations.

FIGURE 9 Botpress QuickCard

Wave position

Botpress CONTENDER

Chatbot learning Deployment and security REFERENCE QUOTES


Chatbot automation Bot management
Architecture/integrations Vendor positioning “The customizability of the
platform itself was a main
Chatbot readiness Road map selling point.”
Development and tooling Market approach
“Even if [the bot] doesn’t have
the right answer, it can assist
Differentiated On par Needs improvement the agent answering the user.”

Products evaluated
Botpress

© 2019 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law. 12
Citations@forrester.com or +1 866-367-7378
FOR INFRASTRUCTURE & OPERATIONS PROFESSIONALS April 15, 2019
The Forrester New Wave™: Standalone Chatbots For IT Operations, Q2 2019
The Eight Providers That Matter Most And How They Stack Up

Inbenta Technologies: Forrester’s Take

Our evaluation found that Inbenta Technologies (see Figure 10):

›› Provides tight knowledge-base integrations and functionality. With native integration to its
separate knowledge-base solution, Inbenta’s strengths lie in its capabilities to navigate, extract, and
summarize data. This makes the solution ideal for developing a robust information-retrieval chatbot.

›› Needs to provide further IT operations oriented functionality. Inbenta is pursuing a broader


chatbot development strategy with an emphasis on customer service and, as a result, has limited
prefabricated IT operations-focused assets like workflows or language models.

›› Is the best fit for organizations pursuing information-focused chatbot support. With strong
knowledge-base capabilities and broad capabilities for internal organization, Inbenta is a good
candidate for helping employees rapidly find the information they need.

Inbenta Technologies Customer Reference Summary

Inbenta Technologies was a nonparticipating vendor, and Forrester was unable to speak with Inbenta
customers for this evaluation.

FIGURE 10 Inbenta QuickCard

Wave position

Inbenta Technologies CONTENDER

Chatbot learning Deployment and security REFERENCE QUOTES


Chatbot automation Bot management
Architecture/integrations Vendor positioning Inbenta Technologies did not
participate in this evaluation
Chatbot readiness Road map and chose not to provide
Development and tooling Market approach references.

Differentiated On par Needs improvement

Products evaluated
Inbenta Chatbot

© 2019 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law. 13
Citations@forrester.com or +1 866-367-7378
FOR INFRASTRUCTURE & OPERATIONS PROFESSIONALS April 15, 2019
The Forrester New Wave™: Standalone Chatbots For IT Operations, Q2 2019
The Eight Providers That Matter Most And How They Stack Up

SnatchBot: Forrester’s Take

Our evaluation found that SnatchBot (see Figure 11):

›› Provides unique in-chatbot features and marketplace. SnatchBot features unique capabilities
such as in-chatbot variable calculation capabilities and provides users with a broad marketplace
for sharing premade chatbots.

›› Needs to address IT operations-focused functionality. To better serve IT operations use cases,


SnatchBot must provide more options related to reporting, granular security, and prebuilt IT
operations workflows and platform integrations.

›› Is the best fit for organizations curious about chatbots. With its free-to-try model and tooling
focused on business analysts, SnatchBot provides a fast way to experiment with chatbots.

SnatchBot Customer Reference Summary

SnatchBot’s reference customers are satisfied with their implementations and are slowly expanding
their use of the tool but noted that more pretrained models are needed.

FIGURE 11 SnatchBot QuickCard

Wave position

SnatchBot CHALLENGER

Chatbot learning Deployment and security REFERENCE QUOTES


Chatbot automation Bot management
Architecture/integrations Vendor positioning “By reducing [context
switching], the bot has
Chatbot readiness Road map drastically increased
Development and tooling Market approach productivity on our team.”

“The bot can be used to enter


Differentiated On par Needs improvement into contact with our team.”

Products evaluated
SnatchBot

© 2019 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law. 14
Citations@forrester.com or +1 866-367-7378
FOR INFRASTRUCTURE & OPERATIONS PROFESSIONALS April 15, 2019
The Forrester New Wave™: Standalone Chatbots For IT Operations, Q2 2019
The Eight Providers That Matter Most And How They Stack Up

Engage With An Analyst


Gain greater confidence in your decisions by working with Forrester thought leaders to apply
our research to your specific business and technology initiatives.

Analyst Inquiry Analyst Advisory Webinar

To help you put research Translate research into Join our online sessions
into practice, connect action by working with on the latest research
with an analyst to discuss an analyst on a specific affecting your business.
your questions in a engagement in the form Each call includes analyst
30-minute phone session of custom strategy Q&A and slides and is
— or opt for a response sessions, workshops, available on-demand.
via email. or speeches.
Learn more.
Learn more. Learn more.

Forrester’s research apps for iOS and Android.


Stay ahead of your competition no matter where you are.

Supplemental Material

The Forrester New Wave Methodology

We conducted primary research to develop a list of vendors that met our criteria for the evaluation and
definition of this emerging market. We evaluated vendors against 10 criteria, seven of which we based
on product functionality and three of which we based on strategy. We also reviewed market presence.
We invited the top emerging vendors in this space to participate in an RFP-style demonstration and
interviewed customer references. We then ranked the vendors along each of the criteria. We used a
summation of the strategy scores to determine placement on the x-axis, a summation of the current
offering scores to determine placement on the y-axis, and the market presence score to determine
marker size. We designated the top-scoring vendors as Leaders.

For some vendors, Forrester was only able to interview one customer reference. For non-participating
vendors, customers were not interviewed, and scoring was based on a briefing, previous analyst
experiences, and public supplementary information.

© 2019 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law. 15
Citations@forrester.com or +1 866-367-7378
FOR INFRASTRUCTURE & OPERATIONS PROFESSIONALS April 15, 2019
The Forrester New Wave™: Standalone Chatbots For IT Operations, Q2 2019
The Eight Providers That Matter Most And How They Stack Up

Integrity Policy

We conduct all our research, including Forrester New Wave evaluations, in accordance with the
Integrity Policy posted on our website.

Endnotes
1
For more on the specifics of these categories and an overview of the wider market of chatbots for IT operations, see
the Forrester report “Now Tech: Chatbots For IT Operations, Q1 2019.”
2
In the context of chatbots, “intents” and “entities” refer to specific concepts. Intents, and intent management, help
the language-processing side of chatbots determine what a user is attempting to do or requesting and help make
a connection between a user’s sentence and what action or workflow to execute. Entities are keywords or types of
keywords, such as a name, a proper noun, or a personal or possessive pronoun, that modify an intent and identify
specific components or variables in a sentence. For example, in the sentence “I would like to reset my password,” the
intent of the sentence would indicate that someone wishes to kick off a password reset workflow, with the entities of
“I” and “my” identifying the user as well as the subject of the password reset.
3
Actively pathing interactions refers to the process of capturing and creating workflows based on agent/chatbot user
interactions in an automated fashion.
4
ITSM is IT service management.

Kore.ai is currently cooperatively developing connections into RPA platforms to supplement its automation
capabilities, with some customers already leveraging these connections.

© 2019 Forrester Research, Inc. Unauthorized copying or distributing is a violation of copyright law. 16
Citations@forrester.com or +1 866-367-7378
We work with business and technology leaders to develop
customer-obsessed strategies that drive growth.
PRODUCTS AND SERVICES
›› Core research and tools
›› Data and analytics
›› Peer collaboration
›› Analyst engagement
›› Consulting
›› Events

Forrester’s research and insights are tailored to your role and


critical business initiatives.
ROLES WE SERVE
Marketing & Strategy Technology Management Technology Industry
Professionals Professionals Professionals
CMO CIO Analyst Relations
B2B Marketing Application Development
B2C Marketing & Delivery
Customer Experience Enterprise Architecture
Customer Insights ›› Infrastructure & Operations
eBusiness & Channel Security & Risk
Strategy Sourcing & Vendor
Management

CLIENT SUPPORT
For information on hard-copy or electronic reprints, please contact Client Support at
+1 866-367-7378, +1 617-613-5730, or clientsupport@forrester.com. We offer quantity
discounts and special pricing for academic and nonprofit institutions.

Forrester Research (Nasdaq: FORR) is one of the most influential research and advisory firms in the world. We work with
business and technology leaders to develop customer-obsessed strategies that drive growth. Through proprietary
research, data, custom consulting, exclusive executive peer groups, and events, the Forrester experience is about a
singular and powerful purpose: to challenge the thinking of our clients to help them lead change in their organizations.
For more information, visit forrester.com. 144395

You might also like