Summary on “Chitty-Chitty-Chat Bot”: Deep

Learning for Conversational AI

Shaniul Islam Shanto

Department of Computer Science and Engineering
University of Dhaka
Dhaka, Bangladesh
shaniulshanto.2331.csedu@gmail.com

Abstract—This paper [1] shows different aspects of non-task
oriented conversation AI. It describes various methods of deep
learning for data collecting , giving responses, handling context,
adding utterances in response, handling multiple answers for a
single question of a conversation AI.
Index Terms—Conversation AI, Deep learning, context, re-
sponse, utterance
I. I NTRODUCTION
With the increasing demands of interactions between hu-
mans and electronic brains, many branches of Artificial in-
teligence are highly calling for contributions from conversa-
tional studies. the ceasless development of web internet i.e.
web 2.0 keeps facilitating many data-driven mathods. Task
oriented and non-task-oriented: two types of conversation AI
are designed to serve people for many purposes. Task oriented
such as reminder or scheduling and booking train or bus
tickets are mainly established in vertical domains. on the
other hand, non-task-oriented is established for the purpose
of random or social chatbots in open domains. These aim to
helps humans for their emotional companionship or as a source
of entertainments.
Here in this paper, we discuss about non-task oriented con-
versation AI named as Chatbot.This survey paper is partially
based on our continuous efforts on building conversational
models with deep learning approaches for chatbots. The paper
summarizes the problem formulation and data collection for
chatbots, and give an overview of state-of-the-art methods for
open domain chit- chats from several aspects.
II. DATA C OLLECTION AND RESPONSE
Conversational AI system functions based on ’query-
response’ method. This method may also deal with contexts
given by the queries hanging on previous utterances. Col-
lecting a huge amount of data from web resources such as
social media or forums in the form of human-to-human con-
versation for interfacing between human-driven conversational
systems and data-driven conversational systems. As massive
Identify applicable funding agency here. If none, delete this.
amount of data available all over the internet, a retrieval-based
conversational system is on high demand. In this method,
system extracts matching metrics, then responds to queries
with candidate responses. Wang et al. [2013] [2] proposed to
construct a two-step retrieval method to deliver appropriate
responses from the massive data repository. Best retrieval
systems extract underlying abstract features of data with
DNN. Generation-based conversational AI, another method to
respond queries, generates responses from a model with the
application of deep-learning. We can effortlessly say that both
systems have pros and cons considering varities of queries and
responses. Although, Retrieval-based system can create natural
and fluent sentences, so mainstream ’real-world’ applications
using this method largely, it fails to create ’new’ appropriate
candidates for a given utterance. generation-based systems can
solve the issues of creating new candidate responses but in
a very limited dataset. Furthermore, it may over-generate or
under-generate unnatural and not so fluent sentences. Finding
candidate responses from both systems and merging them in
order to output the best solutions is the most feasible solution.
III. C ONTEXT BASED C ONVERSATION AI
A proposal for A neural responding machine was raised
for single-turn conversations. [Shang et al.,2015] [3] The
model was then extended to handle multi-turn utterances in
coversation. As studies indicate that context-aware conversa-
tional AI are inevitable, various types of context modeling are
constructed as they all utilize utterances occurred before the
query utterance. Li et al. [2015] [4] suggested that words and
sentences ought to be prototyped on different hierarchies for
representation learning. Context learning is then extended to
hierarchical representations with the action of distinguishing
word-level and utterance-level representations.
IV. P ROACTIVE C ONVERSATION AI
There can be multiple responses for a single query. Fre-
quency of generic and meaningless responses gets higher in
data-driven methodology. So it becomes necessary to optimize
for the likelihood of candidates. Conversational AI should also
be proactive as it is not an ideal assumption that only human
will initiate the conversation and only task of computer is
to respond. So Conversational AI should also be proactive
and introduce new contents to start off conversation. Li et al.
[2016] [5] proposed a proactive conversational system named
StalemateBreaker. The system detects when there occurs a
stalemate, and determines what “intriguing” contents to in-
troduce by re-ranking candidate responses. Diversity can be
achieved by MMR or DPP. Mou et al. [2015] [6] proposed
to introduce new contents, new method such as backward-
and-forward algorithm is needed which starts the sentence
generation from the designated content words.
[5] Xiang Li, Lili Mou, Rui Yan, and Ming Zhang. Stalematebreaker:
A proactive content-introducing approach to automatic human-computer
conversation. ArXiv, abs/1604.04358, 2016.
[6] Ryan Lowe, Michael Noseworthy, Iulian Vlad Serban, Nicolas Angelard-
Gontier, Yoshua Bengio, and Joelle Pineau. Towards an automatic Turing
test: Learning to evaluate dialogue responses. In Proceedings of the
55th Annual Meeting of the Association for Computational Linguistics
(Volume 1: Long Papers), pages 1116–1126, Vancouver, Canada, July
2017. Association for Computational Linguistics.
[7] Lili Mou, Rui Yan, Ge Li, Lu Zhang, and Zhi Jin. Backward and
forward language modeling for constrained sentence generation. arXiv:
Computation and Language, 2015.
[8] Chongyang Tao, Lili Mou, Dongyan Zhao, and Rui Yan. Ruber: An
unsupervised method for automatic evaluation of open-domain dialog
systems. Proceedings of the AAAI Conference on Artificial Intelligence,
32, 01 2017.

V. E VALUATION OF C ONVERSATION AI
There are some metrices like over, ground truth etc for
measuring generated based AI. Automatic evaluation metrics
can be divided into non learnable and learnable approaches.
Lowe et al. [2017] [7] proposed a neural network-based
learning metric for conversation evaluations. A neural network
based automatic evaluation metric predicts scores of ’query-
response’ method as well as the ground-truth response. Later,
Both referenced and unreferenced metrics blended evaluation
routine to render open-domain conversational systems was
proposed and this model doesn’t need any human scoring [Tao
et al., 2018b] [8].

VI. C ONCLUSION
The paper summarizes the problem formulation and data
collection for chatbots, and give an overview of state-of-the-
art methods for open domain chit- chats from several aspects.
It describes various method of data collecting , showing
response, handling context, adding utterance in response , han-
dling multiple answer for a single question of a conversation
AI. The different method of evaluation and evaluation matrices
are also discussed here. This is a well informed paper. I think
the paper is very useful for anyone who wants to work on
conversation AI.

R EFERENCES
[1] Rui Yan. ”chitty-chitty-chat bot”: Deep learning for conversational ai.
In Proceedings of the Twenty-Seventh International Joint Conference on
Artificial Intelligence, IJCAI-18, pages 5520–5526. International Joint
Conferences on Artificial Intelligence Organization, 7 2018.
[2] Hao Wang, Zhengdong Lu, Hang Li, and Enhong Chen. A dataset
for research on short-text conversations. In Proceedings of the 2013
Conference on Empirical Methods in Natural Language Processing,
pages 935–945, Seattle, Washington, USA, October 2013. Association
for Computational Linguistics.
[3] Lifeng Shang, Zhengdong Lu, and Hang Li. Neural responding machine
for short-text conversation. In Proceedings of the 53rd Annual Meeting of
the Association for Computational Linguistics and the 7th International
Joint Conference on Natural Language Processing (Volume 1: Long
Papers), pages 1577–1586, Beijing, China, July 2015. Association for
Computational Linguistics.
[4] Jiwei Li, Thang Luong, and Dan Jurafsky. A hierarchical neural
autoencoder for paragraphs and documents. In Proceedings of the 53rd
Annual Meeting of the Association for Computational Linguistics and
the 7th International Joint Conference on Natural Language Processing
(Volume 1: Long Papers), pages 1106–1115, Beijing, China, July 2015.
Association for Computational Linguistics.