Assignment 1: Evaluation of an IT artefact (web/mobile/car/home appliance)

Assessment (%) Due Date

Task 1:

Pick one app or car/home appliance for your study.

Task 2: 10 Week 4

Create a Google Form as a survey tool to measure:

- Perceived User Usability

Your Google Form should have three (3) sections: Upload your video
presentation in
1. Part A: Respondent background
shorturl.at/pJKOV
2. Part B: Perceived User Usability (Web/Mobile/car/home
appliance) by 5 pm 22April
3. Part C: Comments/suggestion

Questionnaire for Part B is provided as an ATTACHMENT at the end

of these tasks. This is only for the evaluation of website, mobile,
car or home appliance.

Task 3:

Get responses from 20 users (for website, mobile, car or home

appliance).

Task 4:

Website/mobile app/car/home appliance:

1. Analyse your findings using System Usability Scale (SUS).

Details of the method is attached below.
2. Discuss the following:
● Is there any problem or issue with the <name of IT under
study>? What is the problem?
● Are the users satisfied with the <name of IT>?
● What is your suggestion to improve user experience with
<name of IT>?

Task5:
Present your findings creatively in a video PPT presentation

NOTE:

• Name your uploaded file: FullNAme_UiTM#

Assignment 1: Evaluation of an IT artefact (web/mobile/car/home appliance)

ATTACHMENT: Survey Questionnaire for Perceived Usability

Interpreting Scores

The System Usability Scale (SUS) is the most frequently used questionnaire to
measure usability. SUS is frequently used today to measure the usability of websites; its usage
is not limited to websites. It can be used to measure any systems and applications ranging from
digital products such as mobile apps, digital kiosks, laptops to machinery.
How to Calculate Your Usability Score using SUS
1. For each of the odd numbered questions, subtract 1 from the score.
2. For each of the even numbered questions, subtract their value from 5.
3. Take these new values which you have found and add up the total score. Then multiply
this by 2.5.
Based on research, a SUS score above a 68 would be considered above average and anything
below 68 is below average, however the best way to interpret your results involves
“normalizing” the scores to produce a percentile ranking.
Assignment 1: Evaluation of an IT artefact (web/mobile/car/home appliance)

Example:
Aiman Tino, a Web Designer who designed Lazapee Online Shopping website, conducted a survey to
observe the web usability by using System Usability Scale (SUS). There were 10 users taking the survey
that consists of 10 questions which needed to be answered from scale 1 to 5. Scale 1 denotes strongly
disagree while scale 5 implies strongly agree. Column ‘Score’ in Table 1 shows the individual SUS
score for each user. The complete results of the survey is tabulated in Table 1.

Table 1

User / Q Q1 Q2 Q3 Q4 Q5 Q6 Q7 Q8 Q9 Q10 Score

User 1 3 2 4 2 4 3 3 5 2 3 52.50
User 2 1 1 1 1 1 1 1 1 1 1 50.00
User 3 4 2 4 2 5 1 3 3 2 1 72.50
User 4 5 3 3 1 2 2 3 2 3 2 65.00
User 5 3 2 4 4 3 4 2 2 1 2 47.50
User 6 5 2 2 2 1 3 3 1 2 1 60.00
User 7 4 3 4 3 2 4 5 1 5 1 70.00
User 8 3 4 2 1 3 1 3 5 1 2 47.50
User 9 5 2 5 1 1 3 1 1 5 2 70.00
User 10 1 4 1 2 5 2 5 2 5 1 65.00
Discussion:
• 7 users out of 10 found the system is not really usable. The average score for SUS is 68
and the 7 users scored it below than the average.
• Calculation on the average usability score for the survey is
52.50 + 50.00 + 72.50 + 65.00 + 47.50 + 60.00 + 70.00 + 47.50 + 70.00 +65.00
10
=60

• Based on above result the survey found out that the users are not satisfied with the
usability of the system as the overall score is less than the average SUS score,
which is 68.

• Some suggestion on ways that Aiman Tino can help improve the usability of Lazapee (look
at the category questions of the survey)
a. Easy navigation from one page to another
b. Easy payment process
c. Fast page download
d. Clear content organisation
e. Aesthetic look and feel.
References
1. https://www.usability.gov/how-to-and-tools/methods/system-usability-scale.html
2. https://measuringu.com/sus/
3. How To Use The System Usability Scale (SUS) To Evaluate The Usability Of Your Website:
https://usabilitygeek.com/how-to-use-the-system-usability-scale-sus-to-evaluate-the-
usability-of-your-website/
4. Revitalizing SUS, the System Usability Scale
https://meiert.com/en/blog/revitalizing-sus-the-system-usability-scale/