Isabel Velasco Urquiza

MCOM 5364
Dr. Choi
10/06/2023
Research Proposal
Overview
User experience design plays a key role in the development and effectiveness of digital products such as
websites and social media applications. With the introduction of Artificial Intelligence (AI) applications, a
fast-growing field, design effectiveness and user satisfaction are things to keep in mind in the
improvement of these popular systems. This research aims to conduct a comprehensive survey to evaluate
the efficiency of the UX design of two popular AI chatbots, ChatGPT and BARD. By comparing these
two systems, this research seeks to identify which one provides a more effective user experience (user-
friendliness) in order to identify areas where they can improve, as well as provide design solutions that
can benefit both the AI generative learning process and the experience of its users. This research will be
part of a future research project that will explore the effectiveness of these systems in terms of data
analysis, with the purpose of improving both the UX design process and AI’s overall user experience.
Therefore, this study holds significance in the context of advancing AI technology and enhancing user
interactions with AI-powered conversational agents.
Community impacts/practical implications
There is a need to investigate this topic in order to improve the experience of the users. By exploring the
way we interact with these conversational AI systems, we will be able to point out the design or feature
aspects that influence the effectiveness and satisfaction of these interactions. The impact that this study
could potentially have lies in the understanding of these systems’ strengths and weaknesses. As a result,
we will be able to develop more user-friendly, efficient, and accessible AI systems for its users, and
potentially, a broader audience. This, in turn, can impact several fields due to the improved usability of
these systems. The marketing or education fields, for instance, could take advantage of more personalized
and effective experiences when interacting with AI. Lastly, this can benefit AI developers as well as UX
designers in terms of best practices.
Potential Theoretical Implications
This research will have theoretical implications based on the results of the survey and the analysis of this
data. This can shed light on specific elements or features that influence the way users react and respond to
different design solutions in AI conversational systems. The findings could contribute to both the UX
design field and the Human-Computer Interaction (HCI) field with the development or adaptation of
different psychological theories based on how our brains respond to certain designs.
Research Questions and Hypotheses
The purpose of this research is to evaluate and act. For future research, the purpose will be to evaluate,
explain, and test. The following research questions are based on the first purpose.
RQ1: What are the main factors influencing the design effectiveness of ChatGPT and BARD?
RQ2: How do users’ experiences interacting with ChatGPT and BARD differ (and why)?
RQ3: What specific aspects of the UX design of both systems can be improved and/or introduced?
For RQ2 it will be necessary to identify features and patterns that explain how they differ. For RQ3,
different features will be proposed to identify if users would find these useful.
H1: The UX of ChatGPT and BARD will differ significantly in terms of user-friendliness based on the
different features each design solution provides.
H2: Specific areas for improvement will be identified in both systems that will provide insights for
designers and AI developers.
Methodology
To answer the research questions and test the hypotheses, a survey will be conducted of Texas Tech
University students who have used ChatGPT and BARD before. This survey will include questions that
will ask users to rate the user experience of the AI systems based on different categories and
characteristics, such as ease of use, speed, accuracy, appearance, good/bad experiences, and the
implementation of potential features that could improve the overall experience during these interactions.