UX User Testing

DEVELOP A PLAN FOR YOUR USABILITY TEST

Jeff Hurd
PRODUCT LEADER

@JeffHurd
st
th
ns

This bullet list is preset with animations

Overview Use this layout to introduce and/or

summarize the module
Don’t just read a list of topics
Build excitement
Tell the viewer why this is important
- Where would they use this
info on the job?
Scenario Introduction
Scenario Introduction
Scenario Introduction
Scenario Introduction
 “Old” Design Process

Mockup v1 Mockup v2 Low fidelity High fidelity Engineering

prototype prototype
 “Old” Design Process

Mockup v1 Mockup v2 Low fidelity High fidelity Engineering

prototype prototype
 “New” Agile Design Process

Mockup v1 Mockup v2 Low fidelity High fidelity Engineering

prototype prototype
Mockup v1 Mockup v2 Low fidelity High fidelity Engineering
prototype prototype
Mockup v1 Mockup v2 Low fidelity High fidelity Engineering
prototype prototype
User-centered Design Process

1. Specify the business and user needs

2. Build design solutions with rough
concepts
3. Evaluate designs with usability testing
4. Implementation
5. Evaluate outcomes against requirements
 Usability Testing

1. Create a 2. Run the test 3. Analyze 4. Create

test plan test data test report
 What We’re Gathering

Qualitative Quantitative
 What We’re Gathering

I don’t like the font 80% of all visitors clicked

because it looks outdated the header image

Qualitative Quantitative
Planning a User Test

1. Define Goals
2. Determine test format
3. Recruit participants
4. Create tasks and instructions
5. Determine metrics
1. Define the Goals of User Testing

Goals will vary by project

Focus on 1-2 goals at a time
Verify business/team KPIs
Evaluate priority and impact
1. Our Goals

Validate UX of homepage mockups (gather

as much data as possible from user)
Ensure users can complete ‘main’ tasks in
under 30 seconds
2. Determine Test Format

In-person vs. remote

Moderated vs. unmoderated
Test types:
- Tree testing
- AB testing
- Focus groups

- Beta testing
2. Determine Our Test Format

In-person vs. remote

Moderated vs. unmoderated
Covered in the next module
3. Recruit Participants

User personas
How many users necessary?
Recruitment platforms
Pre-screening
Remote vs. in-person
3. Recruit Our Participants

Our user personas

How many users necessary?
Recruitment platforms
4. Create Tasks and Instruction

Link the task to your goals

Keep it simple
Create instructions for the proctor and user
Practice on yourself and co-workers first
4. Create Our Tasks and Instruction

Complete track stress level, Social timeline,

and check current stress level tasks
5. Determine Metrics

Which metrics will you study post-test?

Common usability metrics:
Satisfaction rating (NPS)
Success rate
Error rate
Time to complete
Ensure they support your goals
5. Determine Our Metrics

Which metrics will you study post-test?

Common usability metrics:
Satisfaction rating (NPS)
Success rate
Error rate
Time to complete

Ensure they support your goals

Finish all tasks within x seconds/minutes
st
th
ns

This bullet list is preset with animations

Use this layout to introduce your demo
Demo
How to do this one thing
- Why we do it
- How we do it

Then there’s that thing

Don’t forget to do this
We’ll finish it off with this thing