Professional Documents
Culture Documents
Internet of Things For Smart Ports: Technologies and Challenges
Internet of Things For Smart Ports: Technologies and Challenges
N
owadays, the Internet of Things (IoT) can be con- such as Industry 4.0 of Germany and Made in China 2025 of
sidered an important technological revolution China, the key to these projects is the data provided by sensors.
related to smart cities, smart homes, smart factories Sensors are widely applied in different fields such as smart
and smart ports implementations. As the presence of smart power grids, smart buildings, smart industries, smart cities,
sensing systems in ports becomes a reality, different opera- and smart ports.
tion areas are working today in automatic mode. Examples of A smart port may be defined as a fully automated port
challenging projects related to smart ports in the IoT era can be where all devices are connected via the so-called IoT Smart
found from Europe to Asia, to Australia, and to North Amer- Port. A network of smart sensors and actuators, wireless
ica; in all of these new architecture implementations, sensing devices, and data centers make up the key infrastruc-
technologies play a key role. This paper highlights the main re- ture of the smart port, which allows the port authorities
quirements and the key ideas for each ports, sensing solution to provide essential services in a faster and more efficient
and also the challenges related to the calibration and testing of manner. The major drivers in smart ports are productivity
distributed sensing systems associated with the main equip- and efficiency gains. Various sensors such as inertial sen-
ment that compose the world largest ports, such as quayside sors, ultrasonic sensors, eddy current sensors, radar, lidar,
cranes, automated guided vehicles for container handling imaging sensors, and RFID readers and tags are used to col-
and yard cranes. Details of the architecture and operations lect the required data in order to transform the “port” into
and sensing systems for smart ports are described. Commu- a “smart port.” Pratama et al. proposed a positioning and
nication standards for smart ports are discussed, and smart obstacle avoidance algorithm for Automatic Guided Ve-
ports implementation examples regarding structural health hicles (AGV) in a partially known environment based on
monitoring are considered. Conclusions and future research laser measurement systems and encoders [2]. Li and Xu
opportunities in the IoT era are addressed in the final section proposed a novel fusion positioning strategy for land vehi-
of the paper. cles, which integrated the micro electromechanical-based
inertial measurement unit and virtual sensor, i.e., a sliding-
IoT in Smart Ports mode observer [3]. Kaloop et al. presented steel container
Internet of Things (IoT), as defined by the IEEE, is a network crane movement analysis and assessment based on struc-
of items including sensors and embedded systems which are tural health monitoring, in which accelerometers were used
connected to the Internet and enable physical objects to gather to monitor the dynamic crane behavior, and a 3-D finite
and exchange data [1]. As IoT rises into dominance, sensors element model was designed to express the static displace-
are playing a pivotal role in measuring the physical charac- ment of the crane under the different loads [4]. Carullo and
teristics of objects and converting them into numerical values, Parvis presented an ultrasonic sensor to measure the dis-
which can be read by another device or by the user. In recent tance from the ground to selected points of a motor vehicle
years, the global sensor market has expanded year by year, and [5]. Fu et al. proposed a computer vision-based procedure
it is expected to maintain high growth rates in the future. If we with image sensors to determine the position of one con-
look at the future-oriented projects of various governments, tainer in the horizontal plane [6].
This research is supported by the National Natural Science Foundation of China, Project 6154004, Shanghai Science
and Technology Commission Project 14170501500, Shanghai Science and Technology Commission Project 16DZ2340400,
Shanghai Science and Technology Commission Project 17595810300 and Instituto de Telecomunicações, IT-IUL and
Fundação para Ciencia e Tecnologia Portugal.
Port Architecture and Operation a novelty at Xiamen Ocean Gate, two Rail-mounted Gantry
An automated container terminal consists of the berthing Cranes (RMG) are deployed in the front and back of the yard.
area at the quayside, the travelling area of AGVs and a stor- The RMG gets the container from an AGV-mate and then un-
age yard. More specifically, the berthing area is equipped with loads it into the storage area in the yard or gets the container
quay cranes (QCs) for unloading and loading containers, and from the storage area and then unloads it onto a delivery truck.
the travelling area is used by AGVs to move containers from A layout of a typical automated container terminal is illus-
the berthing area to the storage yard where the storage yard trated in Fig. 1.
stores import and export containers before further delivery by Generally speaking, the container terminal operation
trucks or trains. An automated container terminal mainly uti- mode can be divided into two processes: loading process and
lizes equipment, such as QCs, AGVs, and yard cranes (YCs), unloading process. Fig. 2a shows the concrete operating pro-
for the loading and unloading operation of containers. Thus, cedure of loading and unloading a ship. The AGV receives
the QCs are used to discharge containers from the ship to the discharge instructions (loading instructions) and then puts the
AGVs or for loading containers from AGVs to the ship. AGVs container, which was unloaded by QCs, on the yard blocks. In
implement the horizontal transportation between the shore the unloading procedure: the main trolley first gets the con-
operation and yard operation, and YCs are in charge of put- tainer from the ship and puts it onto the transfer platform
ting the containers in the corresponding locations in the yard. on the QC; then the portal trolley gets the container from the
An example of an automated container terminal is Xiamen transfer platform and unloads it to the AGV; finally, the AGV
Ocean Gate, the first one in China, which has set the stan- puts the container on the AGV-mate in front of the block of the
dard of a global automation terminal handling system. As yard by horizontal transport. The AGV receives the next task
Fig. 2. Automated port terminal operations: a) loading and unloading the ship, b) AGV container operation between quayside and storage yard [7].
instruction at the same time, so it will move on to do the next costs, improving the operation efficiency and economic bene-
mission. The operation sequence is shown in Fig. 2b [7]. The fits, reducing energy consumption, improving the level of safe
use of an AGV-mate reduces the waiting time of the operation operation, and promoting the image of the port and even the
of AGVs and improves the efficiency of the actual operation. image of the city, etc. [8]. According to the estimations, the au-
The AGV-mate has been widely used at the Xiamen Ocean tomated container terminal can save at least 25% more energy
Gate automated container terminal and is considered part of and reduce 15% more carbon emissions than the traditional
the implemented optimization process. terminal as a result of using power-driven vehicles. The whole
There are some new types of automatic equipment, such as terminal's modules communicate with a central control unit of
ZPMC's new gantry cranes, which were designed for container the terminal control room. Therefore, the automated container
ships with 24 transverse container rows. They have 74-me- terminal has become the inevitable development trend of the
trejibs, weigh 2,400 tons and can handle a maximum payload future, implementing technologies associated with distributed
of 110 tons. They are very well-equipped to handle the first smart sensors and actuators, data communication and Internet
18,000-TEU ships with their 23 container rows, which have connectivity for remote and automatic operating, control opti-
just gone into service. ZPMC's new QCs are over 138 m tall, the mization based on artificial intelligence, and big data analysis.
speed of the main trolley arriving at 240 m/min, and the speed
of the gantry goes up to about 45 m/min. They weigh 1,850,000 Sensing Systems for Smart Ports
kg each and can lift four 20-foot containers at one time, han- The automatic container terminal implementation requires the
dling up to 100,000 kg in one lift. They have a 69.5 m lifting use of sensing systems that are employed in tasks such as the
height and extended reach, capable of handling the 25 contain- structural health monitoring of the quayside cranes, container
ers-wide new generation of ultra large container ships (ULCS). position detection and handling, AGV localization, naviga-
Through the comparison and analysis between the tradi- tion and control, etc. The current developments in the field of
tional container terminal and automated container terminal optical fiber sensors, highly sensitive magnetic sensors, and
listed in Table 1, it is clear that the automated port possesses MEMS inertial measurement units that enable the interoper-
many advantages and superiorities, especially in saving labor able wireless protocols, including the latest developments of
4G and 5G that will permit the extension of the Internet con- materials that are detected using eddy current probes that
nectivity of the sensing systems, represent big opportunities include exclusively coils or coils and magnetic sensors such
for new developments in the field of smart ports. Thus, new as the giant magneto resistors [10]. For the ultrasonic sen-
smart sensing architectures for container identification and sor, the presence of flaws in the uniform material will cause
management, vehicle identification and management, loca- the discontinuity of the material, which can cause the acous-
tion and navigation services, and the safety of port terminals tic impedance to be inconsistent. With the reflection theorem,
equipment related to structural health monitoring are based it is known that the ultrasonic wave will be reflected at the
on contact and remote sensing solutions. interface of two different acoustic impedances, and the mag-
Basically, the objective of structural health monitoring nitude of the reflected energy is related to the difference in
(SHM) is to ascertain if damage is present or not based on the acoustic impedance of the interface, the orientation and
measured dynamic or static characteristics of a system to the size of the interface [11]. Therefore, a crack situation in the
be monitored. In smart ports, the contents of SHM focus on metal structure of QCs and RMG can be inferred by analyz-
the identification of stress and strength reserve of the metal ing the signal measured by inductive eddy current sensors
structure in cranes and RMG and on flaws detection, such and ultrasonic sensors.
as micro-cracks, weld cracks and plastic deformation, in the The proximity, level and distance measurement sensors are
process of structural failure where the stress under load is mainly for anti-collision monitoring and location applications
obviously beyond the allowable value. The SHM must be im- of cranes, RMG and AGV in smart ports, where the ultrasonic,
plemented during the entire life-cycle of the equipment. For inductive, laser and IR sensors are the most common, as de-
example, the oblique rods of QCs undertake significant load tailed in Table 3.
and their installation symmetry must be ensured in the manu- Navigation sensors for AGV and unmanned container
facturing stage with strain monitoring technology [9]. During trucks, which are the main container handling equipment
the operation and maintenance process, the health monitoring in smart ports from shore area to container yard, mainly in-
of the bearing structure in the crane and RMG should be con- clude RFID-based navigation systems (HF and UHF RFID
tinuously executed. solutions), differential GPS systems, laser-based navigation
The primary sensing technologies used for SHM in smart systems, inertial navigation systems and encoders, compared
ports are shown in Table 2. Among these technologies, the in Table 4 [12].
strain gauge is the most popular sensing element. The gauge Camera and laser sensors are also used for container moni-
translating the structural strain into resistance change is in- toring, operation safety, non-destructive testing and diagnosis
expensive and stable. Fiber Bragg Grating (FBG) is used to [13]. In smart ports, the transport and storage of containers
sense the influence of strain through a frequency shift and has to be under whole-process monitoring, where the identi-
magnitude change of the reflected beam and is a more ex- fication of the container number can be achieved by camera,
pensive long-term monitoring technology than the strain the location of the container in an AGV or truck can be deter-
gauge. In addition, the eddy current probes and ultrasonic mined by a laser sensor (Fig. 3a), and the automated grab of the
probes are two on-line defect detection technologies. In the container with the crane spreader and the automatic position
electromagnetic field, cracks and other defects will affect alignment between the AGV and container can also be granted
the size and shape of the eddy current in electric conductive by camera and image processing (Fig. 3b).
Fig. 3. Container monitor with a) lidar setup, and b) camera system setup.
Communication Standards for Smart Ports technology. The advantages of RF communication are twofold:
In automated ports, the tendency to “go wireless” is increas- 1) the wireless transmission of RF can achieve 5 km, much far-
ingly obvious due to its flexible-deployment advantage. But ther than other wireless transmission solutions; and 2) due to
there are still some challenging issues during the implementa- the point-to-point feature of RF, users communicate with each
tion of wireless transmission. The most challenging one is that other through RF terminals directly and without extra infra-
these wireless devices are prone to be affected by big metal structure support. But the disadvantages of RF are also evident.
parts and high-power electrical appliances. To tackle this issue, The anti-jamming ability of RF is poor, and data transmit speed
anti-jamming antenna technologies are developed, in which is only 9.6 kbps. In the automated port, RF is mainly applied in
antenna gains can be adjustable self-adaptively according to the communication between ships and ports and among staff in
the interference situation. With the development of anti-jam- remote areas without extra infrastructure support.
ming technologies, the application of wireless communication
will become wider and wider. 4G and 5G solutions: As the fourth generation of mobile tele-
communications technology, the role of 4G in an automated
ZigBee protocol: ZigBee communication protocol is one of the port tends to be more and more important. Compared with
protocols with the highest applicability in wireless sensor net- Wi-Fi, it presents two advantages: 1) the cost of infrastructure
works. Due to its easy-deployment and ad-hoc features, it has is lower since the infrastructure is often developed by national
been widely applied as part of IoT [1] architectures. As far as operators; and 2) its coverage and flexibility is much better. Ex-
an automated port is concerned, the application of ZigBee or cept in some extreme cases, most areas can be covered by base
WSN mainly focuses on structural health monitoring. In this stations of 4G. Whether it is inside or outside the port area,
case the ZigBee nodes are equipped with a strain gauge sensor 4G can provide sustainable transmission service. Therefore,
and deployed on the crucial parts of the port equipment (e.g., most truck-carried terminals are equipped with 4G modules.
yard crane). The ZigBee sensors transmit the sampling data to Since the bandwidth of 4G is relatively limited, transmitting
the base station via multi-hops periodically. Since ZigBee pro- high-resolution video stream is still a challenging task. But the
tocol supports the ad-hoc paradigm, ZigBee sensors organize fast development of 5G technology, “tactile Internet technol-
into a network with each other automatically, significantly fa- ogy” with broader bandwidth, can make up this performance
cilitating the deployment of the monitoring system and later shortcoming.
lowering the maintenance costs. Table 5 presents a comparison list of mainstream wireless
technologies and relevant applications involved in an auto-
Wi-Fi protocol: Wi-Fi protocol seems to be the most welcom- mated port.
ing wireless protocol in the area of automated ports. Due to its
wide-coverage and broad-bandwidth advantages, Wi-Fi pro- Implementation of Smart Port Sensing
tocol is mainly used for video surveillance and AGV remote Systems
control [14]. For instance, the camera deployed on the front of In this section, details are provided about the identification,
a yard crane will deliver a continuous video flow to the surveil- localization, tracking and quayside crane health structure mon-
lance center via Wi-Fi. Through video recognition, the coding itoring applications in smart ports. Identification of stress and
information of containers can be easily known. It is worth not- the strength reserve of the metal structure in cranes and RMG is
ing that to resist the signal interference from regular Wi-Fi (i.e., a very important aspect of SHM. Yao et al. developed a portable
2.4 G UHF), the frequency of Wi-Fi in an automated port is al- wireless strain monitoring system with some IoT technologies
ways 5G SHF ISM. such as ZigBee and WSN (Fig. 4a) [9]. This system combines
self-organization, self-recovery and low power consumption
RF long range data communication: RF long range data com- and aims to improve the monitoring efficiency and meet the se-
munication is a point-to-point wireless communication rious challenges within SHM of quayside cranes (Fig. 4b).
Computer Vision Application for Finally, an example of AGV navigation based on RFID is
Container Identification detailed. In this application, an RFID tag array is installed on
Serial numbers are the basic container information for man- the ground of an AGV operating area, and the AGV obtains
agement in terminals, yards and customs (Fig. 5a). Computer the geographic location information stored in the RFID tags
vision can be applied for automatic identification of the through two readers, which are respectively installed in the
container number and to collect this information as part of front and back of the AGV, as shown in Fig. 6. Thousands of
automatic real-time logistics, solving in this way the critical RFID tags working in 13.56 MHz band with 1 ms reading cycle
issue of container automated management as was imple- are used for AGV positioning and AGV path definition using
mented in some Chinese ports [15]. Using this vision system matrix RFID tags in cells 2 m x 2 m. A drawback of this tech-
can provide automatic identification of the container num- nology is that the foundation settlement caused by heavy duty
ber, seal integrity, the state of the door handle and the lock conditions can lead to the RFID reading failure and the possi-
and door orientation. The system architecture is shown in bility of collision between the AGV during the transportation
Fig. 5b. The packing position and door location information process. Besides AGV navigation, this RFID tag is also used for
are also important for the automatic transport of containers the localization and anti-collision of the quayside cranes.
which have been monitored by the camera and laser sensor.
This system provides the packing position and door location Conclusions
information of containers on AGV or trucks for transport op- Currently, smart ports represent a reality where automatic con-
erations in port, which can facilitate automated management, tainer terminals deploy smart sensing systems to improve the
reduce manpower and improve the container operation performance associated with different terminal tasks. Modern
efficiency. remote sensing technologies such as RFID for identification
and localization and cameras and embedded computer vision important challenges in the port terminal scenario, consider-
algorithms may contribute to safer and reduced time handling ing the metallic obstacles present. Different communication
operations compared to classical container terminals. Safety solutions that are currently used in automated terminal were
conditions are improved using several possible solutions for mentioned, giving special attention to the ZigBee WSN for
structural health structure monitoring for quayside cranes. strain monitoring. Besides the sensing solutions that we pre-
Robust wireless networking and Internet connectivity present sented that currently are part of the optimization of container