Professional Documents
Culture Documents
Usabilty Test - Final
Usabilty Test - Final
Usabilty Test - Final
com Test
Caroline E. Stanford
02/11/2024
Executive Summary
The usability test took place at a home in Athens, Georgia using a laptop on
February 15th, 2024. The purpose of the test is to determine the extent an
interface facilitates a user’s ability to complete routine tasks. Typically, eight
to 10 participants are involved in a usability test to ensure stable results.
However, I have decided to use two participants for this study. Each session
lasted approximately 15 minutes. Participant 1 is a 31-year-old male teacher
specializing in 5th-grade math. Participant 1 spends around 3-5 hours online
daily. While online he prefers to watch podcasts, participate in social media
interaction, and read content such as articles. He has not visited the website
before this session. Participant 1’s favorite websites are LinkedIn, Facebook,
and “X” formally known as Twitter. Participant 2 is a 26-year-old stay-at-
home mom. Participant 2 spends about 7 hours online daily. While online she
prefers to watch podcasts, listen to music, and make online purchases. She
has not visited the website before this session. Participant 2’s favorite
websites are YouTube, Instagram, and Amazon.
After each task, the administrator asked the participant to rate the interface
on a 5-point Likert Scale with measures ranging from Strongly Disagree to
Strongly Agree. Post-task scenario subjective measures included:
How easy it was to find the information from the home page.
Ability to keep track of their location on the website.
Accurateness of predicting which section of the website contained the
information.
After the last task was completed, the test administrator asked the participant
to rate the website overall by using a 5-point Likert scale (Strongly Disagree
to Strongly Agree) for eight subjective measures including:
Ease of use
Frequency of use
Difficulty keeping track of location on the website.
Learn ability - how easy it would be for most users to learn to use
the website
Information facilitation – how quickly participants can find
information.
Look & feel appeal – The homepage’s content makes me want to
explore the site further.
Site content – The site’s content would keep me coming back.
Site organization
In addition, the test administrator asked the participants the following overall
website questions:
What the participant liked most.
What the participant liked least.
Recommendations for improvement.
Participants
I chose two participants. Participant 1 Thierry is a 31-year-old male teacher
specializing in 5th-grade math. Participant 1 spends around 3-5 hours online
daily. While online he prefers to watch podcasts, participate in social media
interaction, and read content such as articles. He has not visited the website
before this session. Participant 1’s favorite websites are LinkedIn, Facebook,
and “X” formally known as Twitter. Participant 2 Alexis is a 26-year-old stay-
at-home mom and entrepreneur. Participant 2 spends about 7 hours online
daily. While online she prefers to watch podcasts, listen to music, and make
online purchases. She has not visited the website before this session.
General occupation
Participants selected their occupation from a general list. Roles included
Educator, stay-at-home parents, unemployed, entrepreneurs, retired, and
other occupations.
Role
Stay-at-home * Other
Educator Unemployed Entrepreneur Retired
parent occupation
1 1 - - - -
Evaluation Tasks/Scenarios
Caroline the Test administrators provided the task to complete. (see
Attachment D for complete test scenarios/tasks and each participant
completed a self-directed task (i.e., a task of their choice) :
Task 1: You are environmentally friendly and would like to find out how
Kleenex is going to reduce its carbon footprint. Find information on
Kleenex.com that advises how their carbon footprint is reduced.
Task 2: You are a volunteer at a children's camp where the flu is
prevalent. Find Kleenex tissue that helps to fight the cold and flu.
Results
Task Completion Success Rate
Caroline The test administrator recorded the participant's task without
prompting. Both participants completed Task 1 (Find information on
Kleenex.com that advises how their carbon footprint is reduced) successfully.
100% of participants completed Task 2 (Find Kleenex tissue that helps to
fight the cold and flu) successfully.
Task Completion Rates
1 √ √
2 √ √
Success 2 2
Completion
100% 100%
Rates
Task Ratings
After the completion of each task, participants rated the ease or difficulty of
completing the task for three factors:
It was easy to find my way to this information from the homepage.
Time on Task
The testing software recorded the time on task for each participant. Some
tasks were slightly more difficult to complete than others, which is reflected
by the average time on task.
Task 1 required participants to find information on Kleenex.com that advises
how their carbon footprint is reduced. This task took the participants the
longest to complete (mean = 555 seconds). Task 2 required participants to
find Kleenex tissue that helps to fight the cold and flu. Task two was
completed in a more timely manner (mean= 300). However, completion
times ranged from 240 seconds (approximately 4 minutes) to 630 seconds
(more than 10 minutes).
Time on Task
Overall Metrics
Overall Ratings
After task session completion, participants rated the site for eight overall
measures. These measures include:
Ease of use
Frequency of use
Difficulty of keeping track of where they were in the site
How quickly most people would learn to use the site
Getting information quickly
Homepage’s content facilities exploration
Relevancy of site content
Site organization
Most of the participants (100%) agreed that the website is well organized and
thought most people would learn about the website fast. Most participants
(85%) agreed they would use the site frequently, thought the website was
easy to use and could get information quickly. 20% of participants agreed
that the homepage’s content would make them want to explore the site and
come back. None of the participants (0%) found it difficult to keep track of
where they were on the website.
Thought Website
1 1 3.9 85%
was easy to use
Would use website
1 1 3.9 85%
frequently
Found it difficult to
keep track of
1 1 2.1 0%
where they were in
website
Thought most
people would learn
1 1 4.8 100%
to use website
quickly
Can get
1 1 3.9 85%
information quickly
Homepage’s
content makes me
1 1 2.0 20%
want to explore
site
Site’s content
would keep me 1 1 2.0 20%
coming back
Website is well 1 1 3.9 85%
Liked Most
The following comments capture what the participants liked most:
Participant 1 liked being able to compare prices from different retailers on the
website with ease as it pops up during checkout.
Participant 2 liked being able to find the product needed with ease.
Liked Least
The following comments capture what the participants liked the least:
Participant 1 disliked the lack of detail in answers for FAQ most contained a
link taking them to another website.
Participant 2 disliked the lack of color and attention-grabbing content on the
website. The participant stated it looked old and cheap.
Recommendations
The recommendations section provides recommended changes and
justifications driven by the participant's success rate, behaviors, and
comments. Each recommendation includes a severity rating. The following
recommendations will improve the overall ease of use and address the areas
where participants experienced problems or found the interface/information
architecture unclear.
Answer the FAQ in more Participants across both tests rated the ease of Medium
detail and without having to finding carbon footprint information quickly with
go to a separate website. 3.9 (out of 5) and only 85% agreed that the
website was well organized.
Include more attention-
grabbing content and colors. Participant comments also included that due to a
lack of excitement and products on the
website(20%), they didn’t feel inclined to revisit High
the website anytime soon(20%)