Professional Documents
Culture Documents
The Effect of Different Training Exercises On The Performance Outcome On The Da Vinci Skills Simulator
The Effect of Different Training Exercises On The Performance Outcome On The Da Vinci Skills Simulator
The Effect of Different Training Exercises On The Performance Outcome On The Da Vinci Skills Simulator
DOI 10.1007/s00464-016-5240-z
123
Surg Endosc
Fig. 1 Exercises selected for trainings curriculum: left column group middle: ‘‘Peg Board 2’’; below: ‘‘Ring and Rail 2’’), right column
1 (above: ‘‘Peg Board 1’’; middle: ‘‘Match Board 2’’; below: ‘‘Needle group 3 (above: ‘‘Ring and Rail 1’’; middle: ‘‘Thread the Rings’’;
Targeting’’), middle column group 2 (above: ‘‘Match Board 1’’; below: ‘‘Match Board 3’’)
the reason to apply it for the present study. It works with different training exercises on the performance outcome in
the Mimic virtual reality training software (Mimic Tech- order to contribute to the development of such a curriculum
nologies, Seattle, WA), which contains more than 35 (Fig. 1).
exercises for robotic skills training, including basic tasks
such as camera control and more advanced exercises such
as suturing and needle driving [3]. According to Gomez Materials and methods
et al., seven main robotic skills need to be achieved during
a training curriculum: camera control, energy control, The study was conducted from December 2014 until
EndoWrist manipulation, basic needle driving, advanced August 2015 on the dVSS in the operating theater of the
needle driving, needle control and fourth arm control [12]. Department of Otorhinolaryngology, Head and Neck Sur-
They allow surgeons to develop the necessary skills to gery, Philipps University, Marburg, Germany. Sixty
master the robotic console. The present study was designed robotic novices, residents in the first training years who
so that all seven of those skills were trained by undertaking performed no robotic operations and did not have experi-
the chosen exercises. ence with the dVSS, were included in this study and were
To our knowledge, at present there is no standard pro- distributed randomly into three equal groups. To minimize
ficiency-based curriculum for training on the dVSS. Thus possible effects of age, only persons between 20 and
the aim of the present study is to analyze the effect of 33 years were included. The training was introduced with a
123
Surg Endosc
brief demonstration of the da Vinci System provided by the addition the ‘‘Needle Targeting’’ (NT) exercise, where
study team to familiarize the participants with the da Vinci colored needles are positioned into two color-matched
console and its handling. Thereafter trainees were allowed targets of different sizes, and the Thread the Rings (TTR)
to familiarize themselves with the da Vinci console by exercise, which required the participant to pass a needle
performing 3 min of the exercise ‘‘Playground.’’ The through different eyelets were trained. The final exercises
training consisted of two sessions with an interval of comprised ‘‘Stacking Challenge,’’ in which the task was to
1 week in between. Exercises of comparable difficulty build the highest possible tower using different tokens and
levels were matched to the three groups. Each group had to ‘‘Energy Dissection 2,’’ which required the participants to
perform three exercises, which consisted of an easy, a cauterize and cut branching blood vessels anchored to a
moderately difficult and a difficult exercise, in a defined vessel truncus. The cauterized small vessels tended to re-
order (Table 1; Fig. 2) three times in a row. On the last bleed, so the participants needed to be attentive to the
study day, two previously unseen exercises were added: whole surgical field to minimize blood loss. Each task was
‘‘Stacking Challenge’’ and ‘‘Energy Dissection 2’’ (Fig. 3). initiated by a short verbal explanation of the exercise to
These two exercises were completed just once by all three follow. The participants then performed the robotic training
groups. autonomously in the presence of the study team. After
Exercises chosen for this study comprised the ‘‘Match successful completion of each exercise, the program ter-
Board’’ (MB) exercises, whose aim is to position three- minated automatically and a detailed performance report
dimensional wooden letters and numbers in corresponding was generated by the Mimic da Vinci Trainer software.
preformed pattern outcuts. From MB 1 to MB 3, the The measured metrics were time taken to complete the
required dexterity rises and extra robotic arms need to be exercise, economy of motion, number of instrument colli-
used to free the pattern outcuts where the objects need to be sions, excessive instrument force, instruments out of view,
placed. The second set of exercises chosen for this study is master work space range, number of drops and overall
the ‘‘Ring and Rail’’ (RR) tasks. Here colored rings are led performance score (all metrics combined). For the ‘‘Needle
along a color-matched rod toward the correct platform. Targeting’’ exercise, the number of missed targets and for
Furthermore the ‘‘Peg Board’’ (PB) exercises were selec- the final exercise ‘‘Energy Dissection 2’’ misapplied energy
ted. They consist of picking up and transferring colored time, blood loss and broken vessels were additionally
rings from a peg board wall to a single peg on the floor. In recorded.
Fig. 2 Final exercises: On the left the exercise ‘‘Energy Dissection 2’’ is shown, on the right the exercise ‘‘Stacking Challenge’’ is pictured
123
Surg Endosc
Fig. 3 Overview of the performance outcome for the overall score column shows the results for group 1, the middle column shows the
for exercises of different difficulty levels (at the head easy, beneath results for group 2 and the left column shows the results for group 3
moderate difficulty, at the bottom difficult exercises). The left middle
123
Surg Endosc
Table 2 Overview over the development of the outcome metrics of the entirety of the exercises performed
Group 1 Group 2 Group 3
Easy Peg Board 1 Match Board 1 Ring and Rail 1
First trial Last trial p value First trial Last trial p value First trial Last trial p value
Mean SD Mean SD Mean SD Mean SD Mean SD Mean SD
Overall 70.9 14.62 90.25 5.12 0.000 60.00 12.3 79.80 7.66 0.000 76.20 12.28 92.75 4.89 0.000
Time to 110.8 44.50 56.85 12.09 0.000 253.35 65.05 150.50 23.72 0.000 73.90 28.02 32.75 10.24 0.000
complete
Economy of 182.55 64.11 129.55 16.91 0.001 381.95 101.43 256.30 33.89 0.000 72.20 38.96 53.45 10.92 0.030
motion
Overall 53.5 12.70 79.9 6.94 0.000 80.10 6.97 91.65 5.27 0.000 46.90 21.25 79.20 7.21 0.000
Time to 248.15 90.53 126.15 19.91 0.000 140.15 31.35 95.3 29.9 0.000 274.30 99.80 147.30 28.55 0.000
complete
Economy of 398.15 134.52 270.05 46.20 0.000 269.80 40.44 222.35 28.95 0.000 351.40 132.58 229.50 31.38 0.000
motion
Overall 71.85 25.76 90.95 10.65 0.001 50.65 19.34 70.90 17.07 0.000 29.60 10.42 61.60 17.09 0.000
Time to 277.00 135.00 147.85 56.41 0.000 382.55 114.29 240.50 86.04 0.000 562.55 200.55 262.55 46.19 0.000
complete
Economy 329.95 211.9 209.90 58.69 0.009 558.30 171.14 432.9 87.87 0.005 896.30 296.04 542.60 76.94 0.000
of motion
three groups (Table 5). Group 1 trained in average questionnaire, most of the participants rated the training
22.25 ± 6.65 min per day, group 2 29.25 ± 6.71 min per on the dVSS as useful (83.3 %) and pleasant (96.7 %)
day and group 3 30.33 ± 8.74 min per day. Proficiency and stated furthermore that they even think that this kind
level, defined as overall score [80 % according to the of training should be integrated into residency programs
recommendation of the developer, was reached in two (71.6 %) (see attachment). The duration of the training
exercises (PB 1, NT) in group 1, in one exercise (PB 2) in was rated as acceptable as most participants could
group 2 and in one exercise in group 3 (RR1) (Table 2). maintain their concentration during the whole training
For the final exercises, a slight significant difference in period (83.3 %). Concerning the effects of the training,
the performance metrics overall score (group 1 vs. 3 most of the participants reported that their dexterity
p = 0.34; group 2 vs. 3 p = 0.47) and points (group 1 vs. 3 (90 %), their handling of the da Vinci instruments
p = 0.32; group 2 vs. 3 p = 0.47) between groups 2 versus (88.3 %) and their three-dimensional visualization (75 %)
3 and groups 1 versus 3 was found for ‘‘Stacking Chal- improved subjectively after the training. A few partici-
lenge’’ (Table 4). pants reported pain in the wrists (20 %) and neck (8.3 %)
after the training, although 60 % thought that their hand
Evaluation of the questionnaire posture improved during the robotic training. Body pos-
ture also subjectively improved for 25 % of the trainees
Almost all participants (59 of 60) (98 %) completed the (see attachment).
16-item survey. Analyzing the main results of the
123
Surg Endosc
123
Surg Endosc
Table 3 Comparison of the performance metrics of the different groups among each other
Group 1 versus Group 2 Group 1 versus Group 3 Group 2 versus Group 3
Easy exercise Peg Board 1 versus Match Board 1 Peg Board 1 versus Ring and Rail 1 Match Board 1 versus Ring and Rail 1
Mean ± SD Mean ± SD p value Mean ± SD Mean ± SD p value Mean ± SD Mean ± SD p value
Overall 70.90 ± 14.62 60.0 ± 13 0.015 70.90 ± 14.62 76.20 ± 12.28 0.222 60.00 ± 12.30 76.20 ± 12.28 0.000
First trial 90.25 ± 5.12 79.8 ± 7.66 0.000 90.25 ± 5.12 92.75 ± 4.89 0.122 79.80 ± 7.66 92.75 ± 4.89 0.000
Last trial 110.80 ± 44.50 253.35 ± 65.05 0.000 110.80 ± 44.50 73.90 ± 28.02 0.004 253.35 ± 65.05 73.90 ± 28.02 0.000
Time to complete 56.85 ± 12.09 150.5 ± 23.72 0.000 56.85 ± 12.09 32.75 ± 10.24 0.000 150.50 ± 23.72 32.75 ± 10.24 0.000
First trial 182.25 ± 64.11 381.95 ± 101.43 0.000 182.55 ± 64.11 72.20 ± 38.97 0.000 381.95 ± 101.43 72.20 ± 38.97 0.000
Last trial 129.55 ± 16.91 256.30 ± 33.89 0.000 129.55 ± 16.91 53.45 ± 10.92 0.000 256.30 ± 33.89 53.45 ± 10.92 0.000
Medium exercise Match Board 2 versus Peg Board 2 Match Board 2 versus Thread the Rings Peg Board 2 versus Thread the Rings
Mean ± SD Mean ± SD p value Mean ± SD Mean ± SD p value Mean ± SD Mean ± SD p value
Overall 53.50 ± 12.70 80.10 ± 6.97 0.000 53.5 ± 12.70 46.9 ± 21.25 0.241 80.10 ± 6.96 46.90 ± 21.25 0.000
First trial 79.90 ± 6.94 91.65 ± 5.27 0.000 79.90 ± 6.94 79.20 ± 7.21 0.756 91.65 ± 5.27 79.20 ± 7.20 0.000
Last trial 248.15 ± 90.53 140.15 ± 31.35 0.000 248.15 ± 90.53 274.3 ± 99.80 0.391 140.15 ± 31.35 274.30 ± 99.80 0.000
Time to complete 126.05 ± 19.91 95.30 ± 29.9 0.001 126.05 ± 19.91 147.30 ± 28.55 0.010 95.30 ± 29.90 147.30 ± 28.55 0.000
First trial 398.15 ± 134.52 269.80 ± 40.44 0.000 398.15 ± 134.52 351.4 ± 132.58 0.275 269.80 ± 40.44 351.40 ± 132.58 0.012
Last trial 270.05 ± 46.20 222.35 ± 28.95 0.000 270.05 ± 46.20 229.50 ± 31.38 0.003 222.35 ± 28.95 229.50 ± 31.38 0.459
Difficult exercise Needle Targeting versus Ring and Rail 2 Needle Targeting versus Match Board 3 Ring and Rail 2 versus Match Board 3
Mean ± SD Mean ± SD p value Mean ± SD Mean ± SD p value Mean ± SD Mean ± SD p value
Overall 71.85 ± 25.76 50.65 ± 19.34 0.006 71.85 ± 25.76 29.60 ± 10.42 0.000 50.65 ± 19.34 29.60 ± 10.42 0.000
First trial 90.95 ± 10.65 70.90 ± 17.07 0.000 90.95 ± 10.65 61.60 ± 17.09 0.000 70.90 ± 17.07 61.60 ± 17.09 0.003
Last trial 277.00 ± 135.00 382.55 ± 114.29 0.011 277.00 ± 135.00 562.55 ± 200.55 0.000 382.55 ± 114.29 562.55 ± 200.55 0.001
Time to complete 147.85 ± 56.41 240.50 ± 86.04 0.000 147.85 ± 56.41 262.50 ± 46.19 0.000 240.50 ± 86.04 262.55 ± 46.19 0.319
First trial 329.95 ± 211.9 558.3 ± 171.14 0.001 329.95 ± 211.9 896.30 ± 296.04 0.000 558.30 ± 171.13 896.30 ± 296.04 0.000
Last trial 209.90 ± 58.69 432.90 ± 87.87 0.000 209.90 ± 58.69 542.60 ± 76.94 0.000 432.90 ± 87.87 542.60 ± 76.94 0.000
123
Surg Endosc
Overall 70.6 ± 9.17 71.5 ± 6.65 71.5 ± 6.5 70.5 ± 5.02 70.6 ± 9.17 70.5 ± 15.02
Time to complete 233.45 ± 74.20 225.15 ± 35.27 225.15 ± 35.27 218.4 ± 57.25 233.45 ± 74.20 218.4 ± 57.25
Economy of motion 220.9 ± 50.31 229.0 ± 34.54 229 ± 34.36 227.2 ± 49.53 220.9 ± 50.31 227.2 ± 49.53
Final exercise Stacking Challenge Stacking Challenge Stacking Challenge
Group 1 versus Group 2 Group 2 versus Group 3 Group 1 versus Group 3
Score ± SD Score ± SD Score ± SD Score ± SD Score ± SD Score ± SD
Overall 28.4 ± 10.10 28.45 ± 12.25 28.45 ± 12.25 19.85 ± 14.13 28.4 ± 10.10 19.85 ± 14.13
Points 42.2 ± 15.16 42.15 ± 18.43 29.25 ± 21.15 42.2 ± 15.16 29.25 ± 21.15
Table 5 Overview of the time needed for each exercise, respectively, each day
Group 1 Group 2 Group 3
Mean (in minutes) ± SD p value Mean (in minutes) ± SD p value Mean (in minutes) ± SD p value
Exercise 1
Time for exercise day 1 4.65 ± 1.5 10.50 ± 1.88 3.10 ± 0.85
Time for exercise day 2 3.3 ± 0.86 0.001 8.25 ± 1.37 0.000 2.00 ± 0.79 0.000
Exercise 2
Time for exercise day 1 9.70 ± 2.15 6.40 ± 1.57 11.00 ± 3.03
Time for exercise day 2 6.70 ± 0.92 0.000 5.10 ± 1.17 0.000 7.80 ± 1.74 0.000
Exercise 3
Time for exercise day 1 11.85 ± 4.22 15.90 ± 4.27 22.25 ± 5.81
Time for exercise day 2 8.2 ± 2.9 0.000 12.35 ± 3.03 0.000 14.40 ± 2.87 0.000
Time for the day
Time for day 1 26.15 ± 6.52 32.80 ± 6.36 36.20 ± 8.13
Time for day 2 18.35 ± 4.03 0.000 25.70 ± 5.04 0.000 24.45 ± 4.24 0.000
Time for day in total 22.25 ± 6.65 29.25 ± 6.71 30.33 ± 8.74
123
Surg Endosc
3. Moglia A, Ferrari V, Morelli L, Ferrari M, Mosca F, Cuschieri A 12. Gomez PP, Willis RE, van Sickle KR (2015) Development of a
(2015) A systematic review of virtual reality simulators for robot- virtual reality robotic surgical curriculum using the da Vinci Si
assisted surgery. Eur Urol. doi:10.1016/j.eururo.2015.09.021 surgical system. Surg Endosc 29(8):2171–2179
4. Gallagher AG, O’Sullivan GC (2011) Fundamentals of surgical 13. Calatayud D, Arora S, Aggarwal R, Kruglikova I, Schulze S,
simulation. Springer, Berlin Funch-Jensen P, Grantcharov T (2010) Warm-up in a virtual
5. Alzahrani THR, Alkhayal A, Delisle J, Drudi L, Gotlieb W, reality environment improves performance in the operating room.
Fraser S, Bergman S, Bladou F, Andonian S, Anidjar M (2013) Ann Surg 251(6):1181–1185
Validation of the da Vinci Surgical Skill Simulator across three 14. Kahol K, Satava RM, Ferrara J, Smith ML (2009) Effect of short-
surgical disciplines: a pilot study. Can Urol Assoc J 7:e520–e529 term pretrial practice on surgical proficiency in simulated envi-
6. Abboudi H, Khan MS, Aboumarzouk O, Guru KA, Challacombe ronments: a randomized trial of the ‘‘preoperative warm-up’’
B, Dasgupta P, Ahmed K (2013) Current status of validation for effect. J Am Coll Surg 208(2):255–268
robotic surgery simulators—a systematic review. BJU Int 15. Sheth SS, Fader AN, Tergas AI, Kushnir CL, Green IC (2014)
111:194–205 Virtual reality robotic surgical simulation: an analysis of gyne-
7. Hung AJ, Jayaratna IS, Teruya K, Desai MM, Gill IS, Goh AC cology trainees. J Surg Educ 71:125–132
(2013) Comparative assessment of three standardized robotic 16. Walliczek U, Förtsch A, Dworschak P, Teymoortash A, Man-
surgery training methods. BJU Int 112:864–871 dapathil M, Werner J, Güldner C (2015) Effect of training fre-
8. Hung AJ, Zehnder P, Patil MB, Cai J, Ng CK, Aron M, Gill IS, quency on the learning curve on the da Vinci Skills Simulator.
Desai MM (2011) Face, content and construct validity of a novel Head Neck. doi:10.1002/hed.24312 [Epub ahead of print], Dec
robotic surgery simulator. Urology 186:1019–1024 17, 2015
9. Lee JY, Mucksavage P, Kerbl DC, Huynh VB, Etafy M, 17. Lyons C, Goldfarb D, Jones SL, Badhiwala N, Miles B, Link R,
McDougall EM (2012) Validation study of a virtual reality Dunkin BJ (2013) Which skills really matter? Proving face,
robotic simulator—role as an assessment tool? J Urol content, and construct validity for a commercial robotic simula-
187:998–1002 tor. Surg Endosc 27:2020–2030
10. Liss MA, Abdelshehid C, Quach S, Lusch A, Graversen J, 18. Patel A, Patel M, Lytle N, Toro JP, Medbery RL, Bluestein S,
Landman J, McDougall EM (2012) Validation, correlation, and Perez SD, Sweeney JF, Davis SS, Lin E (2014) Can we become
comparison of the da Vinci trainer and the da Vinci surgical skills better robot surgeons through simulator practice? Surg Endosc
simulator using the Mimic software for urologic robotic surgical 28:847–853
education. J Endourol 26:1629–1634 19. Tergas AI, Sheth SB, Green IC, Giuntoli RL 2nd, Winder AD,
11. Ramos P, Montez J, Tripp A, Ng CK, Gill IS, Hung AJ (2014) Fader AN (2013) A pilot study of surgical training using a virtual
Face, content, construct and concurrent validity of dry laboratory robotic surgery simulator. JSLS 17(2):219–226
exercises for robotic training using a global assessment tool. BJU
Int 113:836–842
123