Professional Documents
Culture Documents
Hybrid
Hybrid
Hybrid
A R T I C L E I N F O A B S T R A C T
Keywords: Backgrounds: Zygomatic implant (ZI) placement surgery is a viable surgical option for patients with severe
Zygomatic implant surgery maxillary atrophy and insufficient residual maxillary bone. Still, it is difficult and risky due to the long path of ZI
Mixed reality navigation placement and the narrow field of vision. Dynamic navigation is a superior solution, but it presents challenges
Hybrid robotic system
such as requiring operators to have advanced skills and experience. Moreover, the precision and stability of
manual implantation remain inadequate. These issues are anticipated to be addressed by implementing robot-
assisted surgery and achieved by introducing a mixed reality (MR) navigation-guided hybrid robotic system
for ZI placement surgery.
Methods: This study utilized a hybrid robotic system to perform the ZI placement surgery. Our first step was to
reconstruct a virtual 3D model from preoperative cone-beam CT (CBCT) images. We proposed a series of algo
rithms based on coordinate transformation, which includes image-phantom registration, HoloLens-tracker
registration, drill-phantom calibration, and robot-implant calibration, to unify all objects within the same co
ordinate system. These algorithms enable real-time tracking of the surgical drill’s position and orientation
relative to the patient phantom. Subsequently, the surgical drill is directed to the entry position, and the planned
implantation paths are superimposed on the patient phantom using HoloLens 2 for visualization. Finally, the
hybrid robot system performs the processed of drilling, expansion, and placement of ZIs under the guidance of
the MR navigation system.
Results: Phantom experiments of ZI placement were conducted using 10 patient phantoms, with a total of 40 ZIs
inserted. Out of these, 20 were manually implanted, and the remaining 20 were robotically implanted. Com
parisons between the actual implanted ZI paths and the preoperatively planned ZI paths showed that our MR
navigation-guided hybrid robotic system achieved a coronal deviation of 0.887 ± 0.213 mm, an apical deviation
of 1.201 ± 0.318 mm, and an angular deviation of 3.468 ± 0.339◦ This demonstrates significantly better ac
curacy and stability than manual implantation.
Conclusion: Our proposed hybrid robotic system enables automated ZI placement surgery guided by MR navi
gation, achieving greater accuracy and stability compared to manual operations in phantom experiments.
Furthermore, this system is expected to apply to animal and cadaveric experiments, to get a good ready for
clinical studies.
1. Introduction insufficient residual maxillary bone, the zygomatic implant (ZI) has
emerged as the optimal solution for implant surgery. This involves
For edentulous patients with severe maxillary atrophy and implanting the ZI from the alveolar ridge through the maxillary sinus
* Corresponding author at:Room A925, School of Mechanical Engineering, Shanghai Jiao Tong University, 800 Dongchuan Road, Minhang District, Shanghai,
China, Post Code: 200240.
E-mail address: xiaojunchen@sjtu.edu.cn (X. Chen).
1
Xingqi Fan, Yuan Feng and Baoxin Tao have contributed equally to this work.
https://doi.org/10.1016/j.cmpb.2024.108156
Received 22 January 2024; Received in revised form 25 March 2024; Accepted 26 March 2024
Available online 27 March 2024
0169-2607/© 2024 Elsevier B.V. All rights reserved.
X. Fan et al. Computer Methods and Programs in Biomedicine 249 (2024) 108156
into the zygomatic bone, utilizing the zygomatic bone for additional switching of the surgeon’s vision between the surgical site and the
support [1,2]. However, the implantation of ZIs has problems such as a screen and to project the preoperatively planned path directly onto the
long surgical path and a narrow surgical field of view, which hinders surgical site. This study introduces hybrid surgical robots and MR
visualization and increases the risk of surgery. Even a slight deviation in technology into the ZI placement navigation system, achieving the
the entrance position may cause a significant deviation at the zygomatic integration of dynamic navigation, hybrid robots, and MR in zygomatic
bone, potentially leading to the implant mistakenly entering the orbit or implant surgery. The accuracy of the system is verified through phantom
infratemporal fossa [3,4]. Therefore, improving the accuracy of the experiments.
placement of the ZIs is the key to the success of ZI placement surgery.
To enhance the precision of ZI placement surgery, digital technolo 2. Materials and methods
gies such as static surgical templates, dynamic navigation systems, ro
bots, and augmented or mixed reality (AR/MR) technologies have been Based on the hybrid robotic system, the NDI optical navigation de
integrated into ZI placement surgery. Static surgical templates were vice, and the HoloLens 2 MR device, we proposed a set of algorithms,
initially used to guide surgeons on the position and orientation of dril including image-phantom registration, HoloLens-tracker registration,
ling holes [5–7]. However, due to the long and inclined path of zygo drill-phantom calibration, and robot-implant calibration. After
matic implantation, static surgical templates are prone to accumulating completing the registration and calibration algorithms, the MR-based
deviations. Insufficient maxillary bone also makes it challenging to navigation system can integrate the preoperatively planned ZI paths to
provide stable support for the template [8]. The introduction of dynamic the location where the implants will be positioned on the patient
navigation systems in ZI placement surgery is an excellent solution to phantom through the spatial transformation of the translation-rotation
address the aforementioned problems. Many researchers and surgeons matrix. The hybrid robotic system can automatically align the position
have studied dynamic navigation for ZI placement surgery [9,10]. Chen and axis of the ZIs’ path and prepare the cavities for the placement of ZIs
et al. developed a zygomatic implant navigation system and achieved under the guidance of the navigation system.
relatively high accuracy [11,12]. Hung et al. evaluated the accuracy of a
real-time surgical navigation system used for quad zygomatic implant 2.1. Workflow of the MR navigation-based hybrid robotic system
placement [13]. Qin et al. proposed a navigation system for the auto
matic recognition of fiducial points in ZI placement surgery [14]. Wu The overall architecture of our mixed reality navigation-based
et al. validated the feasibility of navigation-guided zygomatic implan hybrid robotic system is shown in Fig. 1.
tation surgery and proposed a workflow [15]. However, the preparation The system is based on an optical tracking device for real-time
process for the dynamic navigation system, such as registration and navigation, an optical see-through head-mounted display (OST-HMD)
calibration, is complex due to the high operational difficulty and steep like HoloLens 2 for implementing MR, and a hybrid robotic system for
learning curve [8,16]. The accuracy and safety of the ZI placement conducting the ZI placement surgery. The development of the MR-based
surgery largely depend on the skills and experience of surgeons. Hence, implant navigation software and the robot-controlling software is based
the clinical implementation of dynamic navigation in ZI placement on several open-source platforms, including VTK, ITK, IGSTK, Qt, Unity,
surgery still encounters significant challenges. and MRTK. The workflow of the system can be divided into four stan
Currently, several surgical robots for dental implant placement can dard steps. Firstly, the utilization of a preoperative planning software
be utilized in clinical surgery, enhancing the precision and stability of called "DentalHelper" is employed to delineate the paths for the place
the procedures [17,18]. At the same time, some studies have also ment of ZI based on the 3D model reconstructed from preoperative CBCT
incorporated surgical robots into the navigation of zygomatic implant images. Secondly, a series of algorithms based on coordinate trans
surgery. They utilize navigation systems to locate the position of the formation, including image-phantom registration, HoloLens-tracker
implant path and employ the robotic system to conduct the surgery. Cao registration, drill-phantom calibration, and robot-implant calibration,
et al. developed a six-degree-of-freedom (6DoF) robot based on a UR are used to unify all objects under the same coordinate system. These
robotic arm and conducted model experiments on zygomatic bone im algorithms will be discussed in detail in Sections 2.3-2.6. After the
plantation using a surgical navigation system. They further optimized registration and calibration procedures, the position and axial direction
the calibration algorithm of the serial robot, improved the accuracy of of the drill relative to the patient phantom can be tracked in real-time
the optical navigation surgical robot system, and conducted animal ex and displayed on the computer screen. The planned implantation
periments [19,20]. Li et al. divided the zygomatic implant surgery into paths are aligned with the patient phantom using HoloLens 2 technol
two stages: the alveolar ridge segment and the zygomatic bone segment. ogy. Finally, the hybrid robot system drives the surgical drills for drilling
They also developed a semi-automatic zygomatic implantation robotic holes, expanding them, and placing ZIs under the guidance of the MR
system to overcome the limitation of patient mouth opening [21–24]. In navigation system.
the field of ZI placement surgery, commercial robots are utilized for
various tasks. Reebye et al. employed the Yomi robot to execute the 2.2. Hardware components
preparation of zygomatic cavities. This involved the initial use of a
standard drill to create a cavity, followed by the insertion of the zygo All hardware devices necessary for our proposed MR navigation-
matic drill into the prepared cavity. Subsequently, the handpiece on the based hybrid robotic system for ZI placement surgery are depicted in
robotic arm was connected, the direction of implantation was secured, Fig. 2.
and the robot was activated to carry out the ZI implantation process. As shown in the devices above, a hybrid robotic system was utilized
[25]. Olivetto et al. proposed a zygomatic implant placement scheme to grasp the handpiece and control the position and orientation of the
guided by ROSA robots [26]. The aforementioned studies have surgical drill along the preoperatively planned ZI path. The planned ZI
demonstrated good accuracy in implant placement. However, the clin paths are visualized using the MR device (Microsoft HoloLens 2), while
ical utilization of robotic systems in ZI placement surgery remains the real-time position and orientation of the drill are determined by an
limited thus far. optical navigation device (NDI Polaris Spectra) tracking the positions of
In our previous study, we developed a hybrid robot designed for reflective balls placed on registration and calibration tools. These
traditional dental implantation, which demonstrated superior implan registration and calibration tools, including the probe, the patient
tation accuracy compared to manual implantation techniques [27–29]. reference frame, and the handpiece reference frame fixed on the hybrid
We have also developed a mixed reality (MR)-based dental implant robot (Zhejiang Zhihang Tianshu Medical Technology Co., Ltd., China),
placement navigation system and conducted phantom experiments [30, were used to establish the positional relationship between objects. The
31]. By introducing MR technology, it is possible to avoid the repetitive patient phantom and the registration cube are made using 3D printing
2
X. Fan et al. Computer Methods and Programs in Biomedicine 249 (2024) 108156
technology (WEILAI 8000 resin, Shenzhen Wenext Technology Co., Ltd, process.
China) with a machining error of 200 μm. Several mini-screws (φ1.7 mm After selecting fiducial markers, a Singular Value Decomposition
× 10 mm) (Jianwei Co., Ltd, Shenzhen, China) were implanted into the (SVD) registration algorithm is used to align the CBCT images with the
alveolar bone of each patient phantom as fiducial markers for image- patient phantom. Define the transformation matrix as the conversion
phantom registration. from coordinate system A to coordinate system B, where TAB is a 4 × 4
matrix capable of both translation and rotation. This can be represented
by the following equation:
2.3. Image-Phantom registration ( )
RBA tAB
In dynamic navigation for ZI placement surgery, it is essential to
B
TA = (1)
0 1
select a series of marker points as fiducial points to display the real-time
3D model reconstructed from the CBCT images on the computer screen. where RBA is a 3 × 3 rotation matrix and tAB is a 3 × 1 translation matrix. In
Corresponding the fiducial points at the same position in the image and this way, for any point P in space, the transformation between coordi
patient phantom one by one is necessary to obtain the transformation
nate systems A and B can be represented by TAB as Eq. (2) and Eq. (3):
matrix between them. Generally, anatomical landmarks such as tooth
cusps, the tip of the nose, and the inner canthus, which maintain a fixed PB = TAB PA (2)
anatomical position during surgery, are chosen as registration markers.
In ZI placement surgery, it is challenging to locate the placement due to pB = RBA pA + tAB (3)
patients typically being edentulous, accompanied by severe alveolar
bone atrophy or maxillary bone defects, making it difficult to rely on where PA = (xA,yA,zA,1)T and pA = (xA,yA,zA)T are the coordinates of
anatomical landmarks. Therefore, 8 titanium screws were implanted point P in coordinate system A, while PB = (xB,yB,zB,1)T and pB = (xB,yB,
into the maxilla of the patient model, and CBCT images were taken. By zB)T are the coordinates of point P in coordinate system B.
matching the vertex of the titanium screws in the CBCT image with those The way to solve matrix TAB using the SVD algorithm is to obtain the
in the patient phantom, the transformation matrix between the image coordinates of the same series of fiducial points in both the A and B
and the patient phantom can be obtained, facilitating the registration coordinate systems. Define the set of fiducial points as S =
3
X. Fan et al. Computer Methods and Programs in Biomedicine 249 (2024) 108156
Therefore, the goal of the SVD algorithm is to obtain the TAB that
PatientRef
TImage = argmin PatientRef
‖PRefi − TImage PImi ‖2
(7)
minimizes the value of F, which satisfies the following equation:
i=1
( )
∑n
B
TA = argmin B
‖PBi − TA PAi ‖2
(5) 2.4. HoloLens-Tracker registration
i=1
For the registration of the CBCT image with the patient phantom, the To visually represent the preoperatively planned ZI paths in the
PatientRef patient phantom more intuitively, a virtual 3D model reconstructed
transformation matrix TImage
needs to be calculated between the
from CBCT images is projected onto the patient phantom using the
image coordinate system OImage and the patient reference coordinate
HoloLens 2 MR device, and the coordinate of the virtual model under the
system OPatientRef. The coordinates of the fiducial point set SIm =
HoloLens 2 device is defined as OVModel. Because the coordinate trans
( PIm1 PIm2 … PImn ) under the OImage have been pre-selected in the formation from the right-hand coordinate system OImage of the CBCT
CBCT image. A probe is then used to determine the coordinates of the image to the left-hand coordinate system OVModel under the HoloLens
( )
fiducial point set SPRef = PPRef1 PPRef2 … PPRefn under the OPatien camera requires a mirror transformation on the x-axis, the coordinate
tRef by placing the tip of the probe on the fiducial points (the vertices of transformation from OImage to OVModel can be represented by a diagonal
the titanium screws). In the coordinate system of the probe, the position matrix:
of the tip is fixed and can be directly obtained by the NDI tracking device
through the transformation matrix TTrackerProbe
. The position and posture
VModel
TImage Image
= TVModel = diag( − 1, 1, 1, 1) (8)
PatientRef
matrix TTracker
of the patient reference frame can also be obtained in To achieve the fusion of virtual and physical models through the
real-time by the tracking device. Therefore, when the probe tip coincides HoloLens 2 device, it is essential to acquire the transformation matrix
with one of the fiducial points, the transformation that converts to the TVModel
Holo
that relates the virtual model to the HoloLens device. Through the
coordinate system of the tracking device holds at both ends of the Eq. (6) continuous transformation of coordinate systems, TVModelHolo
can be calcu
to obtain the coordinates of the selected fiducial point.
lated using the following equation.
( PatientRef )− 1 PatientRef Image
Holo
TVModel Holo
= TTracker TTracker TImage TVModel (9)
4
X. Fan et al. Computer Methods and Programs in Biomedicine 249 (2024) 108156
5
X. Fan et al. Computer Methods and Programs in Biomedicine 249 (2024) 108156
An orthogonalized solution to this equation is: during surgery. Compared to serial mechanisms, parallel mechanisms,
⎛ ⎞ as closed-loop mechanisms, can offer greater stiffness and unique in
x y z
verse kinematics solutions, but they have a limited workspace. There
⎜ ⎟
fore, a hybrid robotic system that combines serial and parallel
2
⎜ y yz ⎟
⎜y − 1 ⎟
DrillTip
RHandRef = ⎜ 1 + x 1 + x ⎟ (15) mechanisms is constructed. The arm of this hybrid robot has 11 degrees
⎜ ⎟
⎝ yz z2 ⎠ of freedom (DoF) and consists of a 5-DoF serial manipulator and a 6-DoF
z − 1
1+x 1+x Stewart platform. The 5-DoF serial manipulator consists of three moving
joints T1, T2, T3, and two rotating joints R1, R2. Joint T1 provides linear
Using the long drill as the surgical tool for ZI placement surgery,
DrillTip LongTip
motion perpendicular to the baseplate, while joints T2 and T3 provide
where tHandRef = tHandRef , then the final calibration matrix is obtained as: linear motion parallel to the baseplate. R1 provides rotational motion
( ) around the axis perpendicular to the baseplate by means of gearing,
RDrillTip DrillTip
tHandRef while R2 provides rotational motion perpendicular to the axis of R1. The
DrillTip
THandRef = HandRef
(16)
0 1 6-DoF Stewart platform comprises a fixed platform, a moving platform,
and six legs, each featuring two gimbals at both ends. During surgical
The complete matrix transformation operation for calibration is
operations, the serial mechanism aids in expanding the workspace and
illustrated in Fig. 4. This process enables real-time tracking of the sur
making coarse adjustments, while the parallel mechanism is crucial for
gical tools’ position and posture relative to the patient phantom by
fine-tuning the position, axial alignment, and the drilling procedure.
creating closed loops with the transformation matrix.
The coordinate systems of the hybrid robotic system were established
During ZI placement surgery, when it is necessary to change the drill,
and illustrated in Fig. 5. The center of the baseplate serves as the origin
the orientation of the drill remains constant, and only the position of the
of the coordinate system O0, and its x, y, and z axes take the direction of
drill tip is adjusted. As a result, the rotational part RDrillTip
HandRef remains movement of T3, T2, and T1, respectively. The coordinate system O1 is
DrillTip
unchanged, and only the translational part tHandRef requires adjustment the center of the moving plane, which has the same axis direction as O0
with the corresponding amount of change. Assuming that the difference and can be obtained by translating O0. The coordinate systems O2 and O3
between the length of the replaced drill and the length of the original are defined on two rotational joints R1 and R2, with their axis of rotation
DrillTip being the z-axis. The end of the serial manipulator and the fixed platform
drill is Δl, then tHandRef becomes:
of the Stewart mechanism were described in the coordinate system O4,
NewDrillTip
tHandRef OldDrillTip
= tHandRef + Δl(x, y, z)T (17) with the z-axis perpendicular to the fixed platform, while the moving
platform was described in the coordinate system O5, with the z-axis
perpendicular to the moving platform.
2.6. Robot-Implant calibration The forward kinematic solution of the serial mechanism can be
calculated using the Denavit-Hartenberg (D-H) method. The trans
Currently, most robots used in implantation applications are serial formation from O0 to O1 involves translation in three directions, and the
mechanisms with large workspaces but low stiffness and non-unique D-H parameters from O1 to O4 are determined as outlined in Table 1,
inverse kinematics solutions. This may result in attitude instability
6
X. Fan et al. Computer Methods and Programs in Biomedicine 249 (2024) 108156
DrillTip
reference frame THandRef is fixed after the drill-phantom calibration, the
Table 1
D-H parameters of the serial mechanism in hybrid robot. position of the handpiece reference frame coordinate system OHandRef
can be uniquely determined. Moreover, the handpiece reference frame is
Coordinate αi-1 ai-1 di θi
fixed to the moving platform, so the transformation matrix with O5,
O1-O2 0 0 d1 HandRef
TO5 is also constant. Consequently, the position of O5 can also be
θ1
O2-O3 − 90◦ 0 0 θ2
O3-O4 − 90◦ d2 d3 0 uniquely determined to obtain TO4 O5
. Subsequently, the inverse kinematic
of the Stewart mechanism is solved, which enables the hybrid robot to
move to the position where the surgical drill aligns with the planned
following the definition provided above. implantation path.
Since the inverse kinematics solution for the Stewart parallel Once the alignment of the drill fixed on the hybrid robot with the
mechanism is unique, a singular solution for the robot’s motion state can planned ZI path is completed, the robot-assisted drilling operation can
be derived when coordinate systems O4 and O5 are provided. The motion be performed under the guidance of the navigation system (Fig. 6A). The
O5
state can also be represented as TO4 using a transformation matrix. location of the drill and its deviation from the preoperatively planned
During the robot-implant calibration process, it is essential to align path can be observed in real-time through the three sectional views and
the tip of the drill with the beginning of the planned ZI path and ensure the 3D view on the screen (Fig. 6B). Moreover, the operator can wear the
that the axial direction of the drill matches the planned ZI path. HoloLens 2 device to observe the alignment between the virtual model
Assuming that the coordinate of the entry point of the planned implant and the physical patient phantom through the HoloLens 2 view
path is represented by (xe,ye,ze) and the normal vector by (vx, vy, vz), (Fig. 6C). They can also verify if the actual path drilled by the robot
then according to the Eq. (15) and Eq. (16), it can be inferred that: aligns with the planned ZI path overlaid on the model (Fig. 6D), enabling
⎛ ⎞ a more intuitive understanding and monitoring of the surgical
vx vy vz xe
⎜ ⎟ procedure.
⎜ vy2 vyvz ⎟
⎜ vy − 1 ye ⎟
⎜ ⎟
PatientRef
TDrillTip PatientRef ⎜
= TImage
1 + vx 1 + vx ⎟ (18) 3. Results of phantom experiments
⎜ ⎟
⎜ vyvz vz2 ⎟
⎜ vz − 1 ze ⎟
⎝ 1 + vx 1 + vx ⎠ A series of phantom experiments were conducted to evaluate the
0 0 0 1 performance of the MR navigation-based hybrid robotic system in
positioning the ZI. The phantoms utilized in this study were derived
Once the transformation matrix of the drill tip under the patient from five patients with atrophied maxilla necessitating the placement of
PatientRef
reference frame TDrillTip is obtained, the coordinates of the drill tip implants in the zygomatic bone. The CBCT images were acquired using
DrillTip
under the NDI tracking device TTracker can also be obtained in real-time. the Planmeca CBCT imaging system (Planmeca Oy, Helsinki, Finland).
Since the transformation matrix between the drill tip and the handpiece Subsequently, an experiment will be carried out to compare robotic
7
X. Fan et al. Computer Methods and Programs in Biomedicine 249 (2024) 108156
Fig. 6. MR navigation-guided hybrid robot-assisted drilling (A: Robot-assisted drilling. B: Real-time navigation. C &D: MR-based navigation under HoloLens 2).
surgery with manual surgery, which will involve the division of partic phantom after the registration. According to Eq. (7), the FRE and TRE
ipants into two groups: one for robotic surgery and the other for manual can be defined as:
surgery. In each group, five phantom experiments will be conducted. √̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅
Phantoms, which are 3D-printed based on the CBCT images of the 1∑n (19)
FRE = ‖PRefi − T PatientRef
Image PImi ‖2
aforementioned five patients, will undergo bilateral zygomatic implant n i=1
placement. Specifically, two zygomatic implants (ZIs) will be placed in m √̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅
1 ∑
each zygomatic bone, resulting in a total of 4 ZIs per phantom, 20 ZIs per TRE = ‖ PRefj − T PatientRef
Image PImj ‖2 (20)
m j=1
group, and 40 ZIs to be implanted in total.
During the phantom experiment, the handpiece and motor system In the context of HoloLens-Tracker registration, the HRE can be
utilized were from Bien-Air (Bien-Air Medical Technologies, defined as the mean distance between a given landmark point set S =
Switzerland), while the drills from Nobel (Nobel Biocare, Sweden) ( P1 P2 … Pm ) on the virtual model displayed by the HoloLens 2
including the Round Bur (φ2.5 mm × 70 mm), Pilot Drill (φ2.9 mm × device and its corresponding position on the patient phantom following
75/95 mm), and Twist Drill (φ3.5 mm × 67.5 mm/100 mm) were the HoloLens-tracker registration process and can be defined as:
employed for the preparation of holes for the placement of dental im
m √̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅
plants. Typically, ZIs with a diameter of 4 mm are chosen for insertion 1 ∑ ( PatientRef )− 1
HRE = ‖ PHoloj − T Holo Tracker T Tracker PRefj ‖2 (21)
into the drilled holes. Various lengths of ZIs are used for different tooth m j=1
positions. A length of 40 mm was selected for the distal position,
whereas 50 mm was selected for the mesial position. For the indicators in drill-phantom registration, the DCE reflects the
average distance of a given landmark point set S = ( P1 P2 … Pm )
within the coordinate systems of the surgical drill tip and the patient
3.1. The systematic error of the MR navigation-based hybrid robotic phantom following the calibration of the surgical instrument and can be
system defined as:
m √̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅
The MR navigation-based hybrid robotic system is susceptible to 1 ∑
DCE = ‖ PRefj − T PatientRef PDrillj ‖2 (22)
errors during various stages, including image-phantom registration, m j=1 Drill
8
X. Fan et al. Computer Methods and Programs in Biomedicine 249 (2024) 108156
9
X. Fan et al. Computer Methods and Programs in Biomedicine 249 (2024) 108156
Fig. 7. The deviation between the actual and planned ZI path (A: Comparison between the planned and actual ZI paths. B: Calculation of deviations between the
planned and actual ZI paths.).
10
X. Fan et al. Computer Methods and Programs in Biomedicine 249 (2024) 108156
11
X. Fan et al. Computer Methods and Programs in Biomedicine 249 (2024) 108156
[8] Y. Wu, B. Tao, K. Lan, Y. Shen, W. Huang, F. Wang, Reliability and accuracy of [21] H. Deng, H. Bian, C. Li, Y. Li, Autonomous dental robotic surgery for zygomatic
dynamic navigation for zygomatic implant placement, Clin. Oral Implants Res. 33 implants: a two-stage technique, J. Prosthet. Dent. (2023).
(2022) 362–376. [22] H. Deng, H. Bian, Y. Liang, J. Cao, Y. Sun, Y. Li, Semi-autonomous two-stage dental
[9] Y. Shen, Q. Dai, B. Tao, W. Huang, F. Wang, K. Lan, Y. Sun, X. Ling, L. Yan, robotic technique for zygomatic implants: an in vitro study, J. Dent. 138 (2023)
Y. Wang, Y. Wu, Real-time dynamic navigation system for the precise quad- 104687.
zygomatic implant placement in a patient with a severely atrophic maxilla, JOVE [23] C. Li, M. Wang, H. Deng, S. Li, X. Fang, Y. Liang, X. Ma, Y. Zhang, Y. Li,
(2021) e62489. Autonomous robotic surgery for zygomatic implant placement and immediately
[10] J.R. González Rueda, I. García Ávila, V.M. de Paz Hermoso, E. Riad Deglow, loaded implant-supported full-arch prosthesis: a preliminary research, Int. J.
Á. Zubizarreta-Macho, J. Pato Mourelo, J. Montero Martín, S. Hernández Montero, ImPlant Dent. 9 (2023) 12.
Accuracy of a computer-aided dynamic navigation system in the placement of [24] H. Deng, J. Wang, L. Liu, Y. Li, Feasibility and accuracy of a task-autonomous robot
zygomatic dental implants: an in vitro study, J. Clin. Med. 11 (2022). for zygomatic implant placement, J. Prosthet. Dent. (2023).
[11] X. Chen, M. Ye, Y. Lin, Y. Wu, C. Wang, Image guided oral implantology and its [25] U.N. Reebye, B.D. Kofford, B.T. Vanderkwaak, L.R. Hattrich, Clinical Case No. 15:
application in the placement of zygoma implants, Comput. Methods Programs zygomatic robotic implant surgery, in: M. Rinaldi (Ed.), Implants and Oral
Biomed. 93 (2009) 162–173. Rehabilitation of the Atrophic Maxilla: Advanced Techniques and Technologies,
[12] X. Chen, Y. Lin, C. Wang, G. Shen, S. Zhang, X. Wang, A surgical navigation system Springer International Publishing, Cham, 2023, pp. 433–438.
for oral and maxillofacial surgery and its application in the treatment of old [26] M. Olivetto, J. Bettoni, S. Testelin, M. Lefranc, Zygomatic implant placement using
zygomatic fractures, Int. J. Med. Robot. Comput. Assist. Surg. 7 (2011) 42–50. a robot-assisted flapless protocol: proof of concept, Int J. Oral. Maxillofac. Surg. 52
[13] K. Hung, F. Wang, H. Wang, W. Zhou, W. Huang, Y. Wu, Accuracy of a real-time (2023) 710–715.
surgical navigation system for the placement of quad zygomatic implants in the [27] Y. Feng, J. Fan, B. Tao, S. Wang, J. Mo, Y. Wu, Q. Liang, X. Chen, An image-guided
severe atrophic maxilla: a pilot clinical study, Clin. Implant. Dent. Relat. Res. 19 hybrid robot system for dental implant surgery, Int. J. Comput. Assist. Radiol. Surg.
(2017) 458–465. 17 (2022) 15–26.
[14] C. Qin, Z. Cao, S. Fan, Y. Wu, Y. Sun, C. Politis, C. Wang, X. Chen, An oral and [28] B. Tao, Y. Feng, X. Fan, K. Lan, M. Zhuang, S. Wang, F. Wang, X. Chen, Y. Wu, The
maxillofacial navigation system for implant placement with automatic accuracy of a novel image-guided hybrid robotic system for dental implant
identification of fiducial points, Int. J. Comput. Assist. Radiol. Surg. 14 (2019) placement: an in vitro study, Int. J. Med. Robot. Comput. Assist. Surg. 19 (2023)
281–289. e2452.
[15] Y. Wu, F. Wang, W. Huang, S. Fan, Real-time navigation in zygomatic implant [29] B. Tao, Y. Feng, X. Fan, M. Zhuang, X. Chen, F. Wang, Y. Wu, Accuracy of dental
placement: workflow, Oral. Maxillofac. Surg. Clin. North Am. 31 (2019) 357–367. implant surgery using dynamic navigation and robotic systems: an in vitro study,
[16] J. Dai, J. Wu, X. Wang, X. Yang, Y. Wu, B. Xu, J. Shi, H. Yu, M. Cai, W. Zhang, J. Dent. 123 (2022) 104170.
L. Zhang, H. Sun, G. Shen, S. Zhang, An excellent navigation system and experience [30] X. Fan, B. Tao, P. Tu, Y. Shen, Y. Wu, X. Chen, A novel mixed reality-guided dental
in craniomaxillofacial navigation surgery: a double-center study, Sci. Rep. 6 (2016) implant placement navigation system based on virtual-actual registration, Comput.
28242. Biol. Med. 166 (2023) 107560.
[17] S. Bi, M. Wang, J. Zou, Y. Gu, C. Zhai, M. Gong, Dental implant navigation system [31] B. Tao, X. Fan, F. Wang, X. Chen, Y. Shen, Y. Wu, Comparison of the accuracy of
based on trinocular stereo vision, Sensors 22 (2022) 2571. dental implant placement using dynamic and augmented reality-based dynamic
[18] S.L. Bolding, U.N. Reebye, Accuracy of haptic robotic guidance of dental implant navigation: an in vitro study, J. Dent. Sci. 19 (2024) 196–202.
surgery for completely edentulous arches, J. Prosthet. Dent. 128 (2022) 639–647. [32] E. Grecchi, L.V. Stefanelli, F. Grecchi, F. Grivetto, A. Franchina, N. Pranno, A novel
[19] Z. Cao, C. Qin, S. Fan, D. Yu, Y. Wu, J. Qin, X. Chen, Pilot study of a surgical robot guided zygomatic implant surgery system compared to free hand: a human cadaver
system for zygomatic implant placement, Med. Eng. Phys. 75 (2020) 72–78. study on accuracy, J. Dent. 119 (2022) 103942.
[20] S. Fan, Z. Cao, C. Qin, F. Wang, W. Huang, X. Chen, Y. Wu, The accuracy of surgical
automatic robotic assisted implants placement in edentulous maxilla – an in vitro
study, Clin. Oral. Implants Res. 29 (2018), 283-283.
12