Research On Digital Production Technology For Traditional Manufacturing Enterprises Based On Industrial Internet of Things in 5G Era

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 14

The International Journal of Advanced Manufacturing Technology

https://doi.org/10.1007/s00170-019-04284-y

ORIGINAL ARTICLE

Research on digital production technology for traditional


manufacturing enterprises based on industrial Internet of Things
in 5G era
Yi Liu 1,2 & KaiDi Tong 1 & Feng Mao 1 & Jie Yang 1

Received: 9 July 2019 / Accepted: 8 August 2019


# Springer-Verlag London Ltd., part of Springer Nature 2019

Abstract
Based on the analysis of 5G and Internet of Things technology, this paper proposes the reference architecture of smart factory and
its application path for traditional manufacturing enterprises in China, in which the intelligent manufacturing workshop is the
core component of smart factory. The Internet of Things technology combined the advanced technologies (Industrial Big Data,
WSN, RFID, Cloud Computing Platform) and provides hardware network foundation and technical theory for designing the real-
time tracking and monitoring system of intelligent workshop products. The developed system has the advantages of low cost,
rapid deployment, and convenient expansion, which traditional manufacturing enterprises realize intelligent management based
on IoT application platform.

Keywords 5G . Industry 4.0 . Internet of Things . Product tracking . Smart factory . Workshop monitoring

1 Introduction However, the Chinese traditional manufacturing enterprises


are not well-functioning in implementation and upgradation
Since the international financial crisis of 2008, some devel- so far. The problems of traditional manufacturing enterprise
oped countries have promoted manufacturing upgradation in faced can be summarized as the follows: There are the serious
order to break through the economic dilemma. The “Industry information island problems of inaccuracy production data,
4.0” is considered as the national strategy and the fourth in- which the information is difficult to share and standardization
dustrial revolution launched by Germany, which has received among the customers and suppliers. The traditional
global attention from all over the world. Its purpose is to manufacturing is inability of the intelligent scheduling on
promote the innovation of the manufacturing development multi-tasks and mixed-flow production equipment resulting
model and the construction of an ecological modern industrial in unreasonable materials dispatching and low equipment uti-
system through the integration of the Internet industry and lization, which the manual intervention still needed in the
manufacturing industry [1]. The Chinese goal is to turn the equipment patrol and quality inspection.
country into the world’s leading and competitive nation at Smart factory, the typical application form of Industry 4.0
manufacturing, digital innovation, and sustainable develop- [2], applies the wireless sensing network and radio frequency
ment based on the guarantee of huge Chinese market. identification technology of the industrial Internet of Things
(IoT) to the production manufacturing, which can promote the
production automation level; improve the production
workflow and scheduling control, utilization of resource,
* Yi Liu
liuyi@hdu.edu.cn
and production efficiency; reduce manufacturing costs; and
enhance manufacturing competitiveness of traditional
1
manufacturing enterprises [3]. Smart factory can realize intel-
Management School, Hangzhou Dianzi University,
ligent manufacturing real-time monitoring of production
Hangzhou 310018, Zhejiang Province, China
2
equipment and the decision-making management on the
The Research Center of Information Technology & Economic and
workshop in the “Internet +” environment through the inte-
Social Development, Hangzhou Dianzi University,
Hangzhou 310018, Zhejiang Province, China gration of the Internet network with industrial manufacturing,
Int J Adv Manuf Technol

which promote the innovation of manufacturing development which the reader reads the encoded data of the electronic tag
and construct the ecological system for modern industrial, (generally the static information such as product code and
which provides the development opportunity of smart factory serial number). The RFID can access and update the corre-
manufacturing workshops in China [4]. sponding information of the product through the application
In the 5G era, the infrastructure for economic and social and database system by connecting to the Internet network
digital transformation will be fully constructed from online to and the transmission client, so that the global physical inter-
offline, from consumption to production, and from platform to connection can be achieved by the remote information query
the ecology, which promote the rapid development of the dig- and management. Its working principle is shown in Fig. 1.
ital economy [5]. Thereby, the distance between all things is Due to the non-contact automatic identification technology,
drawn closer providing the connective flexibility; the intelli- RFID does not require manual intervention in the whole pro-
gent interconnection of people with everything will be real- duction process, so it is very suitable for automatic acquisi-
ized through seamless integration. 5G will become a propeller tion, identification systems in various fields. The advantages
for the development of the Internet of Things. It can be seen of RFID technology are as the follows: (I) non-contact iden-
that the current commercial service of 5G is for the public tification, with high recognition accuracy and high speed; (II)
consumer and the family, and the core global value of 5G in Radio frequency identification can penetrate obstacles (such
the future is reflected in the industry enterprises [6]. as external packaging materials, and containers) to read data
According to Geissbauer et al. [7], a roadmap for digital trans- on electronic tags, which can work normally in tough envi-
formation starts by evaluating company’s own digital level of ronments; (III) It can read multiple tags and identify multiple
maturity “(…) to understand what strengths you can already objects at the same time, which is suitable for situations where
build on , and which systems/processes you may need to in- multiple entities share resources; and (IV) The information
tegrate into future solutions.” When traditional manufacturing storage capacity of the electronic tag chip is much larger than
enterprises are able to respond to digital developmental envi- the previous bar code, which can set the read/write password
ronment in an appropriate way, they can achieve the pre- with the higher security level.
emptive advantage in manufacturing, which implies the po-
tential growth in capabilities of developing products or
services. 2.2 Research on WSN technology of workshop
This paper researches the digital production technology
and the reference architecture of smart factory in the 5G era, Wireless sensor network (WSN) is a group of specialized
which propose the intelligent technical theory and designed transducers with a communication infrastructure for monitor-
the real-time tracking and monitoring system based on the ing and recording conditions at diverse locations, in which
Internet of Things technology including the network integrat- commonly monitored parameters are pressure, vibration in-
ed equipment of CNC machine tools, wireless sensor network, tensity, current voltage, and so on. With the development of
and radio frequency identification network in the workshop. Internet of Things technology, wireless sensor network has
With the application of 5G and Internet of Things technology, become a hot research topic of interdisciplinary and multi-
the manufacturing industry gap between China with Japan, technology, which needed information acquisition system,
Europe, the USA, and other developed countries will be short- network service support, and network communication proto-
ened by constructing the smart factory based on interconnec- col design [9]. The wireless sensor network reference layout
tion of enterprise production, equipment, and other materials, scheme is shown in Fig. 2.
in which the business and manufacturing processes are oper- The traditional manufacturing enterprises have the com-
ated in the flexible, sustainable, and efficient way. plex environment factors and many disturbances in the work-
shop, which the operating status and parameters of the equip-
ment affect the product quality. The WSN technology can
2 Research on smart factory by Internet promote the optimal energy utilization of equipment in the
of Things technology in 5G era workshop through the intelligent scheduling and dispatching
of the sensor nodes idle [10]. According to the historical data
2.1 Research on RFID technology of workshop collection, the coupling relationship between the various
influencing factors of the equipment operation can be ana-
Radio frequency identification (RFID) is the non-contact au- lyzed, and the variation rules for the operating parameters of
tomatic identification technology, which consists of electronic the equipment can be summarized. So that the production
tags, antennas, readers, and application software [8]. The elec- quality can be guaranteed by predicting the abnormal trend
tronic tags are bound to the product items of attachment, print- of the equipment, monitoring the equipment robust condition
ing, slot, and so on. The RFID can store the encoded data from and early warning of the displacement, vibration, or the other
the manufacturing enterprise, the market, and the user, in faults in the manufacturing process.
Int J Adv Manuf Technol

Fig. 1 RFID reader working principle diagram

2.3 Research on industrial big data cloud platform Based on Lambda architecture, the industrial big data cloud
platform constructs the big data system of multi-computing
Industrial big data cloud platform can provide cloud comput- mode, integrated offline, and real-time flow computing, which
ing and big data analyzed for the PB level industrial data can integrate all kinds of big data components such as
through the data sharing cluster, computing service cluster, Hadoop, Kafka, Storm, Spark, HBase, and MPP database
and data warehouse cluster, which uses OpenStack to realize [12]. The new generation of MPP parallel database cluster
hardware resource virtualization, and memory computing has been selected as the core of big data processing platform
technology to enhance all kinds of on-demand resources and to realize the operation of storage, integration, and analysis for
data management performance for traditional manufacturing massive data, which support online query, real-time interac-
enterprise [11]. The physical structure of the industrial big tive analysis, heterogeneous data processing, high-frequency
data cloud platform is shown in Fig. 3. historical data analyze, and visual data display. Traditional

Fig. 2 Workshop wireless sensor network design architecture


Int J Adv Manuf Technol

Fig. 3 The structure of industrial big data cloud platform

manufacturing enterprises build the big data analysis and pro- eliminating it completely [15]. The smart factory reference
cessing platform of smart factory based on data processing architecture based on the edge computing is shown in Fig. 4.
technology of Hadoop for un/semi-structured big data and
online business transaction database system to support intelli-
gent factory.
3 Smart factory design of traditional
2.4 Research on edge computing technology manufacturing enterprise based on Internet
of workshop of Things

Edge computing is the distributed computing paradigm in In order to construct smart factory based on IoT, the traditional
which computation is completely performed on distributed manufacturing enterprise needs the following technical re-
device nodes known as smart devices or edge devices as op- quirements of real-time information transfer network, produc-
posed to primarily taking place in the centralized cloud envi- tion monitor system, and real-time product tracking system,
ronment [13]. The eponymous “edge” refers to the geographic which realize interconnection of production equipment, re-
distribution of computing nodes in the network as Internet of mote operation, and production manufacturing optimization
Things devices, which are at the “edge” of an enterprise, met- in workshop [16].
ropolitan, or other networks. The motivation is to provide
server resources, data analysis, and artificial intelligence (“am-
bient intelligence”) closer to data collection sources and 3.1 The multi-level scheme of big data analysis
cyber-physical systems such as smart sensors and actuators. for traditional manufacturing enterprise
Edge computing is seen as important in the realization of
physical computing, smart factory, ubiquitous computing, and There are many kinds of big data collection in the traditional
the Internet of Things, which is remotely managed autono- manufacturing enterprise, which includes the production and
mous mini datacenters [14]. Like in classic cloud environ- business data from the management information systems, the
ment, staff is centralized and all computers are centrally man- Internet of Things data transmitted from the automation equip-
aged. But they are located on sites not in central datacenter and ment of DCS, PLC, and the external data of market, the
that alleviate WAN bottleneck, for certain applications Internet, and suppliers [17].
Int J Adv Manuf Technol

Fig. 4 Smart factory reference architecture based on the edge computing

I. The Internet of Things data acquisition: The multi- II. Business data collection: The business data of pro-
sources, heterogeneous data of production process (mate- duction and operation be extracted and shared from
rials, process parameters, and equipment operation, etc.) MES, ERP, PDM, PLM, SAP, and CRM in order to
and factory environment information (pollutants, flamma- realize the data management of enterprises by inte-
ble, and harmful gases, etc.) are collected by of various grated Sqoop, Flume, Fluentd, Logstash, Chukwa,
Internet of Things technology combined with RFID, bar Scribe, and parallel ETL and other big data collection
code scanner, PDA, production monitoring equipment, technologies.
and other intelligent terminal sensors, which store in III. External data acquisition: The external data are collected
real-time database and accurately transmit through the from E-commerce platform, WEB, self-media, WeChat,
Internet, bus, and other technologies. Weibo, and so on through the Nutch, Snoopy, and Web

Fig. 5 The diagram of big data analysis network system


Int J Adv Manuf Technol

crawler technologies. The data acquisition of the whole process, and the idle equipment of the corresponding process
network diagram is shown in Fig. 5. is automatically matched, which wireless sensor network pro-
vides new favorite opportunity for smart factory integrated
informatization and industrialization.
The multi-level scheme of big data management analysis The sensor nodes of the workshop continuously transmit
consisted of the AdHoc query, statistical analysis, data min- the digital and analog signals to the coordinator, which make
ing, and knowledge automation decision-making. The AdHoc the automatic corresponding process [19]. The coordinator
query system can flexibly combine query conditions and transmits the signals to the processor for AD conversion and
quickly generate corresponding statistical reports according signal amplification through the serial port asynchronous com-
to specific needs of users. The statistical analysis is suitable munication, and then converts the signals into wireless signals
for the upper business application based on the data statistical through the wireless network card. The wireless monitoring
method and the object analysis knowledge. The data mining video signal transmitted by the high-definition camera is sent
technology can automate reasoning and deductive analysis of to the wireless sensing gateway together, and finally enters the
the potential management value by artificial intelligence tech- workshop local area network and is stored in the database
nology. Knowledge automation decision-making is a disrup- server, and the application terminal such as the control center
tive technology and solution for industrial production sched- converts the collected voltage, current, and other signals into
uling problem in the future based on the knowledge automa- corresponding collection parameter values through a calcula-
tion algorithm of representation, acquisition, association, re- tion program. The smart factory reference architecture based
organization, and reasoning [18]. on wireless sensor network is shown in Fig. 6.

3.2 Design of wireless sensor network in workshop 3.3 Product tracking and monitoring function design
in workshop
The WSN technology is used to extract the workshop state,
equipment state monitoring, and manufacturing information The RFID technology realizes the dynamic information man-
in the manufacturing process, and the work situation of each agement and tracking query of the whole production process
workshop and equipment is reflected in real time so that the by electronical identification through the serial port and net-
workshop process is automatically judged in the production work port. The radio frequency identification network of

Fig. 6 Smart factory architecture based on the Internet of Things


Int J Adv Manuf Technol

intelligent workshop enables all entities of the workshop to the networks into the workshop Ethernet and access the cor-
have unique locations and standardized attributes, which over- porate Internet through the firewall to ensure network and data
come the management problems of manual registration and security. The system architecture model is shown in Fig. 7.
finding tools and tooling in traditional workshops [20]. The
RFID technology realizes the real-time transmission of pro-
cess information encryption and tracks the processing prog- 3.4 Product optimization function design
ress of WIP at any time, which can achieve the automatic on workshop IoT
regulation, resource matching, intelligent decision-making,
and operation management. The production optimization is a key process of the life-cycle
In the workshop, the Internet of Things needs to connect manufacturing management, in which the smart factory simu-
the communication units such as CNC machine tools and lates the practical manufacturing process and proposed the op-
touch screens to realize the real-time communication between timization scheduling of production by big data technology.
the management department and the workshop [21]. With the Considering the influence from the market, employee skill,
network of sensor and RFID in the workshop, the workshop, and process flow constraint, the reasonable and effective pro-
workpiece, and equipment can be connected and paralleled duction scheduling was obtained and adjusted dynamically by
through the transmission of NC code to the CNC machine intelligent optimization algorithm according to the equipment
tool, the transmission of the process documents and the release attribute, external environment data, and the monitored produc-
of tasks, etc. The real-time data of the position and production tion data. In order to optimize the energy consumption, big data
information are converted into wireless data collection host, analysis algorithm can predict the abnormal energy consump-
which can upload the data through the workshop Ethernet tion with the unexpected value in the production process by the
network of the sensors and RFID readers arranged in the real-time data monitoring of power, water, and gas consump-
workshop. In the workshop execution terminal, the workshop tion through automatic acquisition of production data, which
control center makes management decisions based on the real- realize JIT feeding in the whole set of materials and provide the
time database server, and passes the control commands operation decision through real-time production data analysis
through the wireless network. The real-time production data by intelligent system of the on-line RFID equipment platform.
of the workshop send to the integrated controller to control the Figure 8 show the realization of production optimization by
intelligent execution units in the workshop, which integrate all mining and analysis of industrial big data cloud platform.

Fig. 7 System architecture model


Int J Adv Manuf Technol

Fig. 8 The production optimization by industrial big data platform

With the virtual manufacturing, the intelligent factory sim- 4 System implementation for traditional
ulates the whole production process by real-time monitoring manufacturing enterprises
and visualization of the office area [22]. The optimized
manufacturing process makes processing automation, service 4.1 The system implementation by Java, Python,
initiative, and decision-making intelligent through the indus- and Wing
trial IoT system, which reflect the intelligent characteristics of
manufacturing process adaptation, self-optimization, and self- In order to make the real-time tracking and monitoring of the
diagnosis. intelligent manufacturing workshop for the traditional

Fig. 9 The overall functional structure of system implementation


Int J Adv Manuf Technol

Table 1 System development


environment Types Development tools Programming language

Data acquisition server development Hadoop-2.6.0/Python3.5/Eclipse Java


RFID reader development Eclipse/Swing Java
System client development Eclipse Java
Database development Microsoft SQL Server 2012 SQL

manufacturing enterprise under the IoT architecture and ubiq- electronic tag through the radio frequency identification signal,
uitous sensing network, this system is developed and main- update the current status information of the target object, and
tained by Java, Python, Wing, and other service interfaces of transmit the data of the electronic tag from the client to the
SQL or Restful, which achieve the following functions such as remote server database. The memory of the electronic tag can
the workshop monitoring, warehousing management, product be divided into four storage areas; each of which typically
tracking, and DNC statistical analysis, according to the re- contains one or more memory units. EPC area (EPC) is the
quirements of the whole life cycle management and the phys- location for storing the EPC number. Generally, it can store
ical connection of the manufacturing workshop [23]. The im- up to 15 words of EPC number according to the different spec-
plementation architecture of the system is shown in Fig. 9. ifications of reader. It is readable and writable. TID area (TID)
The big data algorithm library is composed of the correla- stores the ID number of the fixed number of digits set by the
tion analysis algorithm, classification algorithm, clustering al- electronic label manufacturer, which is readable and writable.
gorithm, the decision tree, and so on. The manufacturing User area (user) is different for the various vendors. Inpinj’s G2
knowledge and theory of the domain field is deeply excavated tag has no user area. Philips has 8 words of readable and writ-
based on statistical analysis and deep learning method, which able storage area. Password used the four bytes of readable and
has the high confidence level of the large-scale industrial data writable storage area to store the destruction or access pass-
analysis [24]. The analysis algorithm can be programmed and word. The JR301N RFID reader and electronic tags are select-
compiled by Python and Spark MLibrary of Copula (risk ed; the main technical parameters are shown in Tables 3 and 4.
analysis), ExpSmooth (exponential smoothing model), In the RFID communication process, the reader/writer
MovingAVG (moving average model, product demand module should be connected with the host computer via the
growth rate forecast), and Trend (trend analysis). The real- USB/RJ45/RS232/WIFI interface that receives and executes
time data monitoring and product tracking application system the commands from the host computer, in which the RFID
in the workshop is designed and developed by modular pro- system returns the executed result information to the upper-
gramming ideas based on intelligent optimization algorithm layer application. When the host computer sends the com-
[25]. The multi-dimensional analysis results can be presented mand data block to the RFID reader module, the interval be-
as the visual frameworks according to different scenarios by tween adjacent characters must be less than 15 ms. Otherwise,
drilling traceability and reasoning deduction technology. The the previously sent data will be directly discarded by the RFID
development and operation environment of system server and reader module, and the data after 15 ms will be treated as the
client is as shown in Tables 1 and 2. new one. The command data block is re-received until the
read-write module receives the correct command, executes
4.2 Realization of RFID application system the command, and returns the response to the reader module.
in workshop The transmitting process of the response data by the reader/
writer is actually the process of returning the execution result
The RFID reader is an important component to realize the and the response data to the upper computer, when the reader
tracking and positioning of workshop products, which can au- receives and executes the command from the upper computer.
tomatically recognize the target object attached with the
4.3 Realization of CNC machine serial communication

Table 2 System operating environment As a key role in manufacturing, CNC machine tools have been
emphasized by developed countries [26]. However, the differ-
Types Name
ent brands and models of CNC machine tools are used in
Data acquisition server operating system Ubuntu Server 12 various traditional manufacturing enterprises. Therefore, the
RFID read/write operating system, etc. Windows XP, Windows 10 CNC serial communication systems are the key components
System client operating system Windows, Linux, Unix, etc. of CNC machine tools. In order to realize the real-time trans-
JRE JRE1.8 mission of manufacturing data to the workshop, the NC code
is transmitted to the CNC machine tool. The process card, 2D
Int J Adv Manuf Technol

Table 3 Main technical


parameters of RFID reader Equipment model JR301N Working frequency 840~960 MHz

Protocol EPCC1GEN2(ISO18000-6C)
Reading distance 1~100 mm Communication interface RS232/USB
Output power 10~27 dBm Operating voltage 3.3~5.5 V
Operating temperature − 30~70 °C RSSI value Provide RSSI value

drawing, and 3D model are transmitted to the station touch interference ability of the serial transmission. Here, the
screen. The working status of the CNC machine tool and the RS232 and RS485 serial ports are connected into RJ45
production data are uploaded to the upper management de- Ethernet ports through the serial port server, which connects
partment in real time through the network of CNC machine the wireless access device to the wireless network. The wire-
tools, workstation touch screens, and other embedded touch less connector is powered by the Passive PoE network cable,
screens. Due to updating and maintaining the machine tools, so that the AP can get rid of the limitation of the power access
there are various types of CNC machine tools in different point and enable the wireless ,which make the accessor direct-
workshops, which leads to inconsistencies of data and trans- ly attached to the CNC machine. Then, through the AP client,
mission in the reserved network interfaces. At present, the access point client mode of the wireless accesses device, wire-
reserved networking interfaces of CNC machine tools are lessly connects with other APs, and connects all the machine
the RS232, RS485 serial interface, and RJ45 Ethernet port. tools and touch screens in the workshop to the total wireless
Based on the above serial interface and network port, the AP by setting a fixed IP address and MAC address. Finally,
networking scheme of workshop CNC machine tool and sta- the total wireless AP is connected to the database server and
tion touch screen should be achieved as shown in Fig. 10. other computers through the Ethernet switch to realize the
The serial communication is main tools of the CNC ma- wireless networking connection of the CNC machine tool
chine with the special communication protocols according to and the workstation touch screen in workshop.
different numerical control systems. Therefore, different
brands of CNC machine tools need to adopt different proto-
cols to achieve communication function with all CNC ma- 4.4 The data transmission tasks scheduling algorithm
chine tools. Huazhong CNC machine tool is taken into the on Hadoop platform
design serial software flow of communication machine tool
with the special communication protocol. Huazhong CNC From the optimal task load and resource utilization of isom-
system requires the communication program to send a 46- erism environment, the specific implement of the data trans-
character, 92-bit hexadecimal program header before sending mission tasks scheduling algorithm by MapReduce on
the NC code to inform the CNC system, which needed to Hadoop platform is as follows:
receive the file and accept the information. The program head-
er of each NC code indicates the specific meaning that “52” Step 1. In the Hadoop platform, the ApplicationsManager
refers to the machine tool reception, “30” refers to the ordinary keeps the all assigned tasks of MRAppMaster of
file, “3F” indicates that the CNC machine ready to receive, the progress information. The map tasks can be di-
“49 41 00” is the fixed identifier, “4F 31 32 33 34” means that vided into three types of NodeLocal, RackLocal,
the file name sent is “1234” and the file name is 32 bits, so the and offSwitch. Container denotes the real resource
following 0 is used for filling. “31 38 01 00” indicates the size demand by the reciprocal of the task processing
of the file to be sent, and the following “3F 49 41 00” is the time, which reflect the system loss of the resource
fixed identifier. consumption for fault handing backup task. If the
Due to the complex environment in the workshop, the wire primary node receives the new task request from
line should be minimized in order to enhance the anti- the idle node B and the number of backup tasks is

Table 4 Main technical


parameters of RFID electronic Label size 50 × 30 mm Working frequency 840~960 MHz
tags
Protocol EPCC1GEN2(ISO18000-6C)
Data capacity 96bit/512bit Data storage time > 10 years
Data form Read and write Material PET
Anti-interference It is good Operating temperature − 30 °C~60 °C
Int J Adv Manuf Technol

Fig. 10 The CNC machine and workstation touch screen network of intelligent workshop

less than the system default value, then the algorithm profitbackup ¼ −ßremTime*1=avgRunTimeA ð2Þ
will run next step, else the request is ignored.
where the remTime is the evaluation time of the task, œ is the
Step 2. Assumed that node A performs the production tasks
profit weight value of scheduling task, and ß is the expense
and node B performs fault handing backup tasks, the
weight value of scheduling task.
average time of A node to process this type of task is
avgRunTimeA and the average time of B node to profitbackup > profit backup
ð3Þ
process this type of task is avgRunTimeB. remTime > avgRunTimeB þ ß=ðœ þ ßÞavgRunTimeA
Compared the handing backup time of
avgRunTimeB from node B with the threshold of According to formulas (2) and (3), the completed time of
these kinds of nodes with fast or slow values, if there estimatedEndTimeA that node A backup task by the rate of
is fast node, then the algorithm will run next step, progress is obtained, and the average task running time of
else the request is ignored. estimatedRunTimeA at the A node is read.
Step 3. The Hadoop platform will consume 2 Containers for The ApplicationsManager updates the averageRunTime
the execution of scheduling task. When the backup according to the device reports and task type, when each
task is executed on the B node, the profit of cluster is NodeManager sends the device report of the running status
remTime-avgRunTimeB and the profit of node A with and task information.
C on t a i n e r is ( rem Tim e- a vg R u nTim eB ) *1 /
avgRunTimeA. When consuming the time of Step 4. In order to ensure the comprehensive benefits of the
avgRunTimeA by A node with Container and the cluster, the execution of scheduling task considers
time of avgRunTimeB by B node with Container, not only the time but also the load and resource,
t h e p r o f i t o f c l u s t e r i s a v g R u n Ti m e B * which make the definition that ∂ = ß/œ. When the
(1/avgRunTimeA+1/avgRunTimeB). load of cluster is lower and the underutilized re-
sources are more, the scheduling execution of back-
If the task scheduling stops, then the profit of the Container ing up task will not have any impact on the other
is the remTime*1/avgRunTimeA, in which node A consumes tasks at this time; it can be considered that the ex-
the time of remTime. Therefore, the cluster benefits of the two pense weight value of the scheduling execution is
cases are as follows: smaller and the value of ∂ trends to 0. On the other
hand, when the load of cluster is higher and more
profitbackup ¼ œðremTime−avgRunTimeBÞ*1= ð1Þ tasks wait for resources at this time, the scheduling
avgRunTimeA−ßavgRunTimeB* execution of backing up task will extend the progress
ð1=avgRunTimeA þ 1=avgRunTimeBÞ of other tasks and the expense weight value of the
Int J Adv Manuf Technol

scheduling execution is bigger and the value of ∂ Table 5 The offline optimal load scheduling algorithm by MapReduce
on Hadoop platform
trends to ∞. When the load of cluster is lower, then
∂ = 0(ß = 0), else ∂ = ∞(ß = ∞). Thus, the difference private Map<Node, List<TaskInProgress>>
value of ∂ is calculated according to formula (4). createCache(JobClient.RawSplit[] splits, int maxLevel) {
Map<Node, List<TaskInProgress>> cache=new
IdentityHashMap<Node, List<TaskInProgress>>(maxLevel);
∂ ¼ capabilityscheduled =capabilitylimit ð4Þ for (int i = 0; i < splits.length; i++) {
String[] splitLocations = splits[i].getLocations(); // obtain the physical
location of the data slice
where capabilityscheduled indicates the allocation amount of if (splitLocations.length == 0) {
resources and capabilitylimit means the availability amount of nonLocalMaps.add(maps[i]);
resources. continue; }
After the calculation of ∂, the tasks are ranked by descend- for(String host: splitLocations) { //Resolvedata copy in which cluster
according to the physical location of node
ing order according to formula (5). Node node = jobtracker.resolveAndAddToTopology(host);
LOG.info("tip:" + maps[i].getTIPId() + " has split on node:" + node);
currentTimestamp þ remTime > currentTimestamp ð5Þ for (int j = 0; j < maxLevel; j++) {
þ avgRunTimeB þ ß=ðœ þ ßÞ*avgRunTimeA List<TaskInProgress> hostMaps = cache.get(node);
if (hostMaps == null) { //mount the Map task to the node
According to the task information reported by the node, hostMaps = new ArrayList<TaskInProgress>();
ApplicationsManager calculates the task processing ability cache.put(node, hostMaps);
hostMaps.add(maps[i]); }
of the corresponding node and obtains the processing time
if (hostMaps.get(hostMaps.size() - 1) != maps[i]) { // avoid the same
threshold of different types nodes. Map tasks mount at parent node
hostMaps.add(maps[i]); }
Step 5. After calculating the estimatedEndTimeB, the task of node = node.getParent(); //obtained the parent node }
}
the largest difference is selected by formula (1) in
return cache; }
Step 3, judge whether the scheduling algorithm is private synchronized int findNewMapTask(final TaskTrackerStatus tts,
executed according to formula (6). final int clusterSize, final int numUniqueHosts, final int
maxCacheLevel, final double avgProgress) { ………. }
private synchronized TaskScheduler(Collection<TaskInProgress> list,
estimatedEndTimeA > estimatedEndTimeB ð6Þ
TaskTrackerStatus ttStatus, double avgProgress, long currentTime,
þ ∂=ð1 þ ∂Þ*avgeRunTimeA boolean shouldRemove) {
Input: TaskInProgress
The MRAppMaster obtains the totalCapabilityLimit the to- Output: TaskScheduler
tal available resources in the cluster by the function //Initial Stage
AllocateResponse#getAvailableResources. avgRunTimeB=getAvgRunTime();
avgRunTimeA=getAvgRunTime();
progress =getCurrentProgress();
Step 6. The totalCapabilityscheduled is the total statistic estimateEndTimeA=Yarn default and progress;
number of Container in MRAppMaster wherein estimateEndTimeB=getCurrentTime() and avgRunTime;
t h e s t a t u s o f Ta s k A t t e m p t i s d e f i n e d a s totalCapabilityLimit=getAvailableResources();
For( i=1 To totalNumberTask Do){
UNASSIGNED. In order to implement the schedul- If TaskAttempt==Unassigned {
ing program, the interface of TaskScheduler is re- capabilityScheduled=getScheduledResources();
vised by formula (7). totalCapabilityScheduled+=capabilityScheduled; } }
// TaskScheduler Stage
While( task is runing )Do {
estimatedEndTimeA−∂=ð1 þ ∂Þ*avgRunTimeA > estimatedEndTimeB
r=totalCapabilityLimit/totalCapabilitySchedule;
ð7Þ value=estimatedEndTimeA-R/(1+r)*avgRunTimeA;
For( sort(value) Do) {
The implement steps and codes of the data transmission If( Max(value)>estimateEndTimeB ){
speculativeExecution(); } } }
tasks scheduling algorithm are as follows and are shown in
Table 5.

4.5 Testified system for traditional manufacturing enterprises by IoT technology,


industrial big data cloud platform, and so on [27]. All the
The workshop monitoring system real-time analyzes the production equipment connected with the MQX bus realize
delay-sensitive data of material and equipment from the auto- the real-time acquisition, the co-operation, and unified control
matic interact sensors of the production line based on the among the people, devices, and equipment. The collection
optimization algorithm, which provide the optimal scheme result is continuously uploaded to the database server in real
Int J Adv Manuf Technol

Fig. 11 Workshop data acquisition curve of the motor load current

time. The workshop monitoring system continuously reads status by connecting the CNC shearing machine, CNC
the sensor signal of data collection information from the server punching machine, CNC bending machine, and other equip-
database according to the set frequency, performs the opera- ment in workshop. Figure 12 shows the statistical data of start-
tion and determination program, and shows the real-time sta- up rate, operation rate, and failure rate of workshop equipment,
tus signal of the production equipment. Figure 11 shows the in which managers can grasp the real-time operation informa-
monitoring data of equipment machines in workshop, which tion of production equipment, such as operation status, failure
the motor current signal or measured digital power unit of rate, and production efficiency of equipment at any time.
each channel is collected into the data acquisition server. If The management ability of traditional manufacturing en-
the motor current exceeds the threshold value or deviates terprises will be promoted by data analysis on the production
greatly from the historical statistical data, the system will equipment base on the establishment of the whole life-cycle
make alert that the equipment is seriously worn-out and needs management, which can improve the production process and
to replace spare parts. the manufacturing quality by shortening the production lead
The industrial cloud platform can realize the full data trans- time and reducing the manual intervention in the production
mission and real-time monitoring of equipment production process. The automatic level of traditional manufacturing

Fig. 12 The equipment operation statistics and fault prediction


Int J Adv Manuf Technol

enterprises will be enhanced about 13% through the intelligent 8. Shellshear E, Berlin R, Carlson JS (2015) Maximizing smart factory
systems by incrementally updating point clouds. IEEE Compute
operation and remote monitoring system, in which the re-
Graph Appl 35(2):62–69
sponse time of process handover and the on-site quality su- 9. Bandyopadhyay D, Sen J (2011) Internet of things: applications and
pervision will be reduced from 15 to 3 s in average. challenges in technology and standardization. Wirel Pers Commun
58(1):49–69
10. Duan Q, Zeng J, Chakrabarty K, Dispoto G (2015) Real-time pro-
duction scheduler for digital-print-service providers based on a dy-
5 Conclusion namic incremental evolutionary algorithm. IEEE Trans Autom Sci
Eng 12(2):701–715
11. Wang XW (2014) Big data drives manufacturing towards intelli-
This paper proposes the reference architecture and construc-
gence. Internet Things Technol 12:7–8
tion path of smart factory for traditional manufacturing enter- 12. Dayal U, Gupta C, Vennelakanti R et al (2014) An approach to
prises in China, pointing out that the industrial Internet of benchmarking industrial big data applications. WBDB2014,
Things and the intelligent manufacturing workshop are the August. Springer International Publishing, Potsdam, pp 45–60
core components of smart factory, which research the big data 13. Koustabh D, Kanti DS (2017) Comparison of edge computing
implementations: fog computing, cloudlet and mobile edge com-
analysis, product tracking method, and real-time monitoring puting. IEEE 2017 Global Internet of Things Summit (GIoTS),
technology in the application of smart factory. The intelligent Geneva, pp 1–6
manufacturing workshop of real-time tracking and monitoring 14. Bonomi F, Milito R, Zhu J, Addepalli S (2012) Fog computing and
system is built based on the Internet of Things including the its role in the internet of things. Proceedings of the first edition of
the MCC workshop on Mobile cloud computing. ACM 13–16
CNC machine tools, wireless sensor network, and radio fre-
15. Condoluci M, Dohler M, Araniti G, Molinaro A, Zheng K (2015)
quency identification network. Through the real-time process- Toward 5G dense nets: architectural advances for effective
ing of production data from upstream and downstream supply machine-type communications over femtocells. IEEE Commun
chain by IoT network platform, traditional manufacturing en- Mag 53(1):134–141
terprises realize intelligent management by monitoring the 16. Jung K, Choi SS, Kulvatunyou B, Cho H, Morris KC (2017) A
reference activity model for smart factory design and improvement.
material usage of the production line and the maximize effi- Prod Plan Control 28(2):108–122
ciency scheme of production optimization, which has the ad- 17. Agiwal M, Saxena N, Roy A (2019) Towards connected living: 5G
vantages of low cost, strong applicability, rapid deployment, enabled Internet of Things (IoT). IETE Tech Rev 36(2):190–202
and convenient expansion. 18. Wang F-Y (2013) The destiny: towards knowledge automation-
preface of the special issue for the 50th anniversary of Acta
Automatica Sinica. Acta Automat Sin 39(11):1741–1743
Funding information This work is supported by the Zhejiang Provincial
19. Chen G, Wang C, Liang Z, Arinez J, Xiao G (2016) Transient
Natural Science Foundation of China (Grant Nos. LY18G020009,
performance analysis of serial production lines with geometric ma-
LQ17D010005) and the National Natural Science Foundation of China
chines. IEEE Trans Autom Control 61(4):877–891
(Grant Nos. 71831006, 71804038).
20. Silva GCD, Kaminski PC (2015) Application of digital factory
concepts to optimise and integrate inventories in automotive pre-
assembly areas. Int J Comput Integr Manuf 28(6):607–615
21. Bonomi F (2011) Connected vehicles, the internet of things, and fog
References computing. In The eighth ACM international workshop on vehicu-
lar inter-networking (VANET), Las Vegas, USA, pp. 13–15
1. Machado CG, Winroth M, Carlsson D, Almström P, Centerholt V, 22. Choi SS, Bo HK, Sang DN (2015) A diagnosis and evaluation
Hallin M (2019) Industry 4.0 readiness in manufacturing companies: method for strategic planning and systematic design of a virtual
challenges and enablers towards increased digitalization. Procedia factory in smart manufacturing systems. Int J Precis Eng Manuf
CIRP 81:1113–1118 16(6):1107–1115
2. Chen B, Wan J, Lei S, Peng L, Mukherjee M, Yin B (2018) Smart 23. Weyer S, Meyer T, Ohmer M, Gorecky D, Zühlke D (2016) Future
factory of industry 4.0: key technologies, application case, and chal- modeling and simulation of cps-based factories: an example from
lenges. IEEE Access 6(99):6505–6519 the automotive industry. IFAC Papers Online 49(31):97–102
3. Geissbauer R, Vedso J, Stefan S. (2016) Industry 4.0: building the 24. Liu Y, Feng M, Li Y (2019) Data analysis with python: principal
digital enterprise. PwC NL, 2016 Global Industry Survey and practice. Tsinghua University Press. ISBN: 9787302515791
4. Chien CF, Hong TY, Guo HZ (2017) An empirical study for smart 25. Sun Y, Lin F, Xu H (2018) Multi-objective optimization of resource
production for TFT-LCD to empower industry 3.5. J Chin Inst Eng scheduling in fog computing using an improved NSGA-II. Wirel
40(7):552–561 Pers Commun 102(2):1369–1385
5. Tehrani M, Uysal M, Yanikomeroglu H (2014) Device-to-device 26. Datta SK, Bonnet C, Haerri J (2015) Fog computing architecture to
communication in 5G cellular networks: challenges, solutions, and enable consumer centric internet of things services. 2015
future directions. IEEE Commun Mag 52(5):86–92 International Symposium on Consumer Electronics (ISCE), 1–6
6. Palattella M, Dohler M, Grieco A, Rizzo G, Torsner J, Engel T, Ladid 27. Lyu X, Ni W, Tian H, Liu RP, Wang X, Giannakis GB, Paulraj A
L (2016) Internet of things in the 5G era: enablers, architecture and (2017) Optimal scheduling of mobile edge computing for internet
business models. IEEE J Sel Areas Commun 34(3):510–527 of things using partial information. IEEE J Sel Areas Commun
7. Westerman G, Tannou M, Bonnet D, Ferraris P, McAfee A. (2012) 35(11):2606–2615
The digital advantage: how digital leaders outperform their peers in
every industry. MIT Center for Digital Business and Capgemini Publisher’s note Springer Nature remains neutral with regard to jurisdic-
Consulting tional claims in published maps and institutional affiliations.

You might also like