ChatGPT or

BARD?
A User Experience Design Analysis of AI
Chatbots
Isabel Velasco Urquiza
 Overview
• UX Design plays a key role in the development
and effectiveness of digital products
• “A person's perceptions and responses that
result from the use or anticipated use of a
product, system or service.”
• This research aims to conduct a comprehensive
survey to evaluate the efficiency of the UX
design of two popular AI chatbots, ChatGPT and
BARD.
• Advance AI technology and enhance user
interactions with AI-powered conversational
agents.
Community Impacts/practical
implications

3
 Research Questions
• RQ1: What are the main factors influencing the design
effectiveness of ChatGPT and BARD?
• RQ2: Which AI chatbot has a more user-friendly interface?
(Why?)
• RQ3: What specific aspects of the UX design of both systems
can be improved and/or introduced?

4
 Hypotheses
• H1: The UX of ChatGPT and BARD will differ significantly in
terms of user-friendliness based on the different features each
design solution provides.
Design (interface) ------ Usability
• H2: The satisfaction rates of both ChatGPT and BARD will show
room for improvement in terms of usability.
Usability ----- Satisfaction
• H3: (How easy is it to remember tasks/operations?) The
systems’ designs affect the retainability of tasks.
Design (interface)-------Retainability
5
 Results Ease of use (usability)

Recover from mistakes easily/quickly Effortless Can be used without written instructions

4%
8%

20%
40%
40%

32%

60%
60%

36%

Sontrgly agree Somewhat agree Sontrgly agree Somewhat agree

Neither agree nor disagree Somewhat disagree Neither agree nor disagree Somewhat disagree Sontrgly agree Somewhat agree Neither agree nor disagree
Strongly disagree Strongly disagree Somewhat disagree Strongly disagree
 Results Ease of use (usability)

70%

60%

50%

40% Sum of Sontrgly agree

Sum of Somewhat agree
Sum of Neither agree nor disagree
Sum of Somewhat disagree
30%
Sum of Strongly disagree

20%

10%

0%
Can be used without written instructions Easy to use Effortless Recover from mistakes easily/quickly
 Results Usability

Usefulness Easy to use

50% 80%

45% 70%
40%
60%
35%
50%
30%
40%
25%

20% 30%

15% 20%

10%
10%
5%
0%
0% Sontrgly agree Somewhat agree Neither agree nor Somewhat Strongly disagree
Extremely useful Very useful Moderately useful Sligthly useful Not at all useful disagree disagree

ChatGPT BARD ChatGPT BARD

 Results Retainability/learnability

Ease of learning Designed for all levels of users

70% 60%

60%
50%

50%
40%

40%
30%
30%

20%
20%

10%
10%

0% 0%
Sontrgly agree Somewhat agree Neither agree nor Somewhat disagree Strongly disagree Sontrgly Somewhat Neither Somewhat Strongly
disagree agree agree agree nor disagree disagree
disagree
C Series2

ChatGPT BARD
 Results Satisfaction

Satisfaction Speed and Reliability

60% 9

8
50%
7

40% 6

5
30%
4

20% 3

2
10%
1

0% 0
very satisfied Satisfied Neutral Not satisfied Very unsatisfied Speed Reliability

ChatGPT BARD ChatGPT BARD

 Results Interface

Items are easy to find Interface is pleasant

50% 60%

45%
50%
40%

35%
40%
30%

25% 30%

20%
20%
15%

10%
10%
5%

0% 0%
Sontrgly agree Somewhat agree Neither agree nor Somewhat disagree Strongly disagree Sontrgly agree Somewhat agree Neither agree nor Somewhat disagree Strongly disagree
disagree disagree

ChatGPT BARD ChatGPT BARD

 Based on the results (key findings):
Overall, we can see that ChatGPT has higher satisfaction rates among users. Other aspects of the
variables analyzed also show how ChatGPT offers a better UX design solution compared to BARD.
Some of the features that influence the design effectiveness based on the results are:

- Inefficient search functionality

- “Slower” performance
- Issues with reliability
- The design layout

The system’s design affects the learnability and retainability of tasks, and this could be improved with
user testing, customization options, and maybe including a user feedback mechanism within the platform
to allow users to report issues.
Correlations
BARD
• Interface ---- Usability: Statistically significant (negative)
• Usability ---- satisfaction: Positive relationship (weak)
• Interface ---- Retainability: Negative relationship (weak)
ChatGPT
• Interface ---- Usability: Positive relationship (weak)
• Usability ---- satisfaction: Statistically significant (positive)
• Interface ---- Retainability: Positive relationship (weak)
H1 and H2 were supported, while H3 was not supported finding a weak
relationship (interface and retainability)
 Limitations

• Limited generalizability: the study only focuses on two AI Chatbots and

does not take into account 1)other chatbots 2)other forms of AI
• Limited insight into retainability: does not dive deeper into the
mechanisms influencing this variable.
• Demographics: small sample with most individuals being 21-24 and the
majority being white males.
Thanks!