USABILITYTESTINGREPORT

1.TaskScenario

Thetaskscenarioinour(Kinect)usabilitytestingwasasfollows:userwasgivena
paperwithexercisedescription(drawing)andwassupposedtodothisexercisein
frontofKinect.BytheendofthesessionKinectprovideduserwithastatistics.

2.Participants

Participantsdescription

Age

Gender

Height

Clothing

Participant#1

20

183

Denimshorts
&greytshirt

Participant#2

19

163

Blackjeans&
blacktshirt

Participant#3

20

158

Darkblue
jeans&white
blouse

Participant#4

19

150

Lightblue
jeans&grey
tshirt

Participant#5

19

165

Blackleggings
&stripedtunic

Participant#6

20

172

Blackjeans&
yellowpullover

Participant#7

19

169

Darkblue
sportsuit

Participant#8

20

165

Grey
sweatpants&
blacktshirt

Participant#9

21

180

Darkblue
jeans&white
hoodie

Participant#10

20

183

Darkblue
jeans&white
tshirt

Participant#11

18

171

Lightpink
pajamapants
&tshirt

Summary

Age

Gender

Height

18

19

20

21

150
159

160
169

170
179

180
189

Amount

3.Methodology
Theaveragetimeofsessionswasabout1minute.Duringthesesessionsthe
participantsfacedwithvariousproblems.Theparticipantwereaskedtofollowthe
instructionspresentedinapaperonly.So,theyhadtodoinstructionswithoutour
help.Duetothespecificexercisespecifications,sometimessomeparticipantsfailed
todotaskscorrectly.Aftertheexercisedonethepositiveinstructionsprocedurewas
explainedtotheparticipants.Almostallofthemansweredthatitwasobviousand
easyandtheydidnottrytothinkinthatway.Oneofthepreandpostquestionnaires
wasabouttheirexercisecomprehensionanddifficulty.

4.Results

Sittingonthe Understanding Implementing Meanrate

correctsideof theexercise
theexercise across
tasks
thetable

Participant#1

success

success

success

100%

Participant#2

fail

success

fail

33%

Participant#3

fail

success

success

67%

Participant#4

success

success

fail

67%

Participant#5

success

success

fail

67%

Participant#6

success

success

success

100%

Participant#7

fail

success

success

67%

Participant#8

fail

success

fail

33%

Participant#9

fail

success

success

67%

Participant#10

success

success

success

100%

Participant#11

success

success

fail

67%

Task
completionrate

55%

100%

55%

70%

Fromthetableaboveitcanbeseenthatinaveragethesuccessofthesessions
completionis70%.Participantswereevaluatedbytheresultsofthreemaintasks
(sittingonthecorrectsideofthetable,understandingtheexercise,implementingthe
exercise).
Thefirsttasksuccesscompletionrateis55%.Thereasonforthis(asitwas
questionedafterthesession)isthatpeopledidnotthinkofwheretositatall,
whereastheothersunderstoodthattheyprobablyneedtositinthewaythatKinect
seestheirarmproperlytherealsowasonecasewherepersonsatcorrectly
accidentally(butgotfailanyway).Thisresultmadeusunderstandthatweneedto
provideclearinstructionforpatientswheretosit.
Thesecondtasksuccesscompletionrateis100%.Alloftheparticipantsanswered
inpostsessioninterviewthatitwaseasytounderstandhowtodotheexercise.
Thethirdtasksuccesscompletionrateis55%.Alloftheparticipantswhogotfail
weredoingtheexercisetoofastwhichledinwrongKinectfeedback(asKinectwas
comparingthewrongplacementofanarm).Althoughwethinkthatitisbecause
peopledonothavearealarmfracture,wewillincludeinstructionsforpatientstodo
anexerciseslowlyasNao).

5.Findings
1. AsthereweretwosittingplacesaroundthetableinfrontofKinect,person
wassupposedtositonthesidesothathisbrokenarmbeingclosertothe
Kinect(thannotbrokenone).Butnotalloftheparticipantsunderstoodthat
andweresittinginawrongwayresultinginKinecthavingsomedifficulties
inrecognizingtheskeleton.
2. Aspeoplewereofdifferentheightsandwewereusingtableandsofasand
chairsfromthedormitorytheyfeltuncomfortablewhilesittinghunched.
However,theirphysicalappearancesdidnotinterfereKinectswork.
3. SincewehaveusedonlyKinectwithoutNAOrobot,onetroublehad
occurredisthattheparticipantsdidnotknowwithwhatspeeddotheyneed
todoexercise,meaninghowfastorhowsloworwiththemoderatespeed.

6.Conclusion/FutureWork

Inthisusabilitytestwehavetested11participantsdifferingingender,age,height
andothercharacteristics.Duringthissessionsomeoftheparticipantsclearly
understoodhowtotakethisdemotherapyjustaccordingtoprovidedpictureswith
simpleinstructionsandittook2530secondstocomplete4cycles,someofthe
participantsittook3070secondsthisisduetomisunderstoodofwhatisneedtodo
andunclearinstructionsaccordingtotheirwords.Alsoitwasnoticedthatforsomeof
theparticipantsitwasveryinterestingofhowitworksandtheywasreallyinvolved
andinterestedinprocessandmaybebecauseofthatitalsotooklesstimethan
thoseforwhomittook3070seconds.Definitelythereweresomeproblemsduring
thisusabilitytest.Oneofthemisthatnoteveryoneclearlyunderstoodhowtosit
properlysothatKinectwillbeabletorecognizethehand,soinfuturewewillinclude
theproperinstructionsofhowtositcorrectly.Anotherproblembutnotsovaluableis
thatwhiletakingthistestsomeoftheparticipantstookplaceonchairsorsofasand
theheightsaredifferentrelativetotheheightoftablewheretheyputtheirhand.So
infutureforourbetterimplementationofprojectitwouldbebettertouseatableof
medium(usual)heightandanadjustablechair.Onemoreproblemwasthespeed
withwhichtheparticipantsmustdotheexercise.Tosumup,asyoucanseewe
haveminorproblemssuchassuitablechair,clearinstructionsbutthemajorproblem
whichcanbeseenfromtableisthatonly55%tooksittingofcorrectsideofthetable
andinfutureweneedtosolvethatproblemandtakeintoaccountinourproject.