Professional Documents
Culture Documents
The Evolution and Challenges of Modern Distributed Control Systems
The Evolution and Challenges of Modern Distributed Control Systems
net/publication/342222085
CITATION READS
1 994
4 authors:
Some of the authors of this publication are also working on these related projects:
A practical approach to IEC 61850 standard for automation, protection and control of substations View project
All content following this page was uploaded by Balduino Camachi on 25 August 2020.
Abstract—This paper presents the evolution and As shown schematically in Figure 1 and detailed in the
development trends of the distributed control systems (DCS) following chapters, the future development of DCS must
implemented in the Electrical Power Systems, highlighting the ensure:
impact of the modern versus traditional DCS systems. The - High availability, achieved through the redundancy of
principles of the modern DCS systems presented in this paper the equipment components of the system;
can be found implemented in Romania in the Transmission and - Cybersecurity;
Distribution energy sector, implemented by the Romanian - Cloud computing, both in the intranet environment
Transmission and System Operator CNTEE Transelectrica SA
(private) and in the internet environment (public);
and, as well as the electricity distribution operators like
- Server virtualization, in order to reduce the costs of the
Electrica, EoN and CEZ.
hardware equipment, their maintenance and maintenance
Keywords—DCS, SCADA, HMI, RTU, ERP, Cyber Security, through the optimal use of the existing hardware resources
Virtualization, substation, redundancy. which are classically used at a reduced capacity;
- Integration of DCS into ERP (Enterprise Resource
I. INTRODUCTION Planning) systems in order to quickly process a very large
volume of data and adjust the production parameters in real
The rapid evolution of technology has made it possible to
time to market requirements.
reduce the production costs of the equipment components of
Distributed Control Systems (DCS), which results in a large- II. DCS SYSTEMS OVERVIEW
scale implementation. Basically, one cannot talk about a
modernization in the Electric Power System without A. The DCS concept
considering the implementation of a DCS system. A Distributed Control System, with a typical architecture
Although modern DCS continue to provide basic presented in Figure 2, is a monitoring and control system for
functions, just as traditional DCS systems, namely monitoring an industrial process or plant, in which the monitoring and
and controlling a large volume of inputs / outputs, they have control elements are distributed throughout the system.
evolved to interconnect all monitoring and control equipment,
ensuring full visibility of all data at the central level, usually
in the power plant / substation control room [1].
Redundancy
Modern DCS challenges
Cybersecurity
Cloud Computing
Virtualization
ERP integration
Fig.1 Modern DCS challenges Fig.2 Distributed Control System (DCS) architecture (adapted from [2])
Authorized licensed use limited to: University College London. Downloaded on June 19,2020 at 08:12:44 UTC from IEEE Xplore. Restrictions apply.
D. A. Poștovei et al. • The evolution and challenges of modern Distributed Control Systems
000090
Authorized licensed use limited to: University College London. Downloaded on June 19,2020 at 08:12:44 UTC from IEEE Xplore. Restrictions apply.
SACI 2020 • IEEE 14th International Symposium on Applied Computational Intelligence and Informatics • May 21-23 • Timişoara, Romania
000091
Authorized licensed use limited to: University College London. Downloaded on June 19,2020 at 08:12:44 UTC from IEEE Xplore. Restrictions apply.
D. A. Poștovei et al. • The evolution and challenges of modern Distributed Control Systems
Nowadays most of companies and some universities have IV. STUDY CASE - RAURENI 220/110 KV SUBSTATION
their own cloud platform and virtual infrastructure, where they In order to highlight the evolution and development
run business critical application and store data [10]. trends of DCS systems in the last 10 years, a case study was
By default, DCS are considered to implement closed performed in the area with the highest dynamics, namely the
automation systems and moving just partially some processes Power Transmission sector.
in cloud is at this point only a distant prospect, but this trend The study case analyzes two DSC architectures, belonging
imposed by modern IT systems will also influence the design to the same electric power substation selected for
of future DCS. There are many advantages in this regard, modernization, respectively Raureni 220/110 kV. This high
namely the elimination of the physical dependence between voltage substation, which is part of Romania Transmissions
hardware and software, the rapid recovery and restoration of power grid, was selected for modernization for the first time
the system in case of hardware defects as well as a great in 2008, but due to the economic crisis, the investment was
flexibility in the configuration and testing phase. put on hold. When the investment was resumed in 2018, after
The disadvantage would be the high cost of implementing a period of 10 years, the DCS implementation had to meet the
a private intranet-based IT system which can provide an requirements of the newest international standards, the newest
increased security, so that the DCS domain is separated from internal norms (NTI) of the Beneficiary CNTEE
the other areas of activity of the company. Transelectrica SA, and up to date software and technology.
Migrating DCS applications to the Internet (public) space
is not currently being discussed, precisely because of STUDY CASE RESULTS:
uncertainties on the Cybersecurity threats.
A. 2008-RAURENI 220/110 KV SUBSTATION
D. Virtualization
Scope: Delivery of new DCS system;
In a nutshell, virtualization is a process of sharing physical Supplier: Areva T&D France;
resources between several virtual entities, and in the case of Network redundancy: RSTP and ring architecture;
DCS systems, it is specifically addressed to process servers. Implemented communication protocols: Ethernet,
DCS system providers have already been incorporated into IEC 61850, IEC 60870-5-103, IEC 60870–5–101,
the software platform the "server virtualization" functions, Modbus and Courier.
especially for the configuration, simulation and testing part The substation 2008 architecture was designed based on
and for the school activities. Of course, virtualization is not Ethernet network, with three DCS levels: Level 0- Field level;
appropriate for the entire DCS, given that hardware dedicated Level 1-Direct Control; Level 3-Plant Supervisory [12].
for very short response time (milliseconds) or real-time The field devices such as circuit breakers, disconnectors,
applications which cannot be replaced with a software power transformers control and monitoring systems and
application running on a virtual machine. AC/DC auxiliary services were directly hardwired to the
The slow pace of virtualization is dictated by the existence monitoring and control IEDs, namely BCUs designed to
of own hardware and software platforms of DCS providers, exchange data with the system servers through the network
which represents a major technical obstacle in the widespread and IEC 61850 protocol.
adoption of virtualization. In the last 15 years, DCS providers All BCUs are equipped with Ethernet communication
have managed to standardize only in terms of communication boards, which makes it possible to create a communication
protocols and here we mention the industrial protocol ring for these elements through these internal switches.
IEC61850 [11], while a standardization of hardware or DCS Although it is an economic solution represent a big issue in
software platforms remains a purpose for the future. The the safe operation of the system.
adoption of the IEC61850 protocol practically by all DCS All the other IEDs, like protection relay are physically
system providers was mainly determined by the need to connected to those BCUs by a serial interface and IEC 60870-
reduce the costs of integrating controllers and monitoring and 5-103 Master-Slave communication protocol [13]. In this type
control equipment from other providers and less from the need of communication, a network issue of a BCU will cut the
for a common standard. This can also be seen from the protection relays communication with the system servers, and
different implementation of DCS system providers, system automatically with operator interface (HMI) and SCADA
architectures, automation software or HMI interfaces. interface (NCC), while the protection functions are still in
Last but not least, the "dependence" on technology and place. A double fault, meaning that two BCUs being
mobility of each of us makes DCS aligned with this trend, and disconnected from the network, represent a major disruption
in the coming years all providers will invest heavily in tablet of the DCS system, due to the inability to monitor and control
and smartphone applications, mainly for monitoring and alarm all the devices located between the two defective BCUs.
and even in extended control command functions. The voltage, current and tap position indicators, pressure
E. Enterprise and Resource Planning integration and temperature sensors are connected to BCUs by RS485
serial interface and Modbus, a Master-Slave communication
Although ERP systems are found especially in
protocol as well.
manufacturing facilities, there is a tendency to adapt DCS to
integrate them into ERP systems as well. This aspect resulted In addition to above standard protocol, Courier a
proprietary Areva protocol was used to build a protection
from the need to process a large volume of information in a
short time and for a better connection between the serial network, needed for extracting logs and events from the
protection relays and available at EWS (Engineering
administrative and management side with the monitoring and
Workstation) interface and plant supervisory level.
control of the technological process.
The above-mentioned major disruption in the DCS system
Resuming, the costs of implementing an ERP system make
is applicable for Courier network and all Modbus devices too.
sense for a DCS from a refinery, power plant, nuclear power
The communication with the NCC is managed by
plant and are not yet justified for a DCS from a power
redundant Gateways using IEC 60870-5-101, a Master-Slave
transmission and distribution substation.
communication protocol [14].
000092
Authorized licensed use limited to: University College London. Downloaded on June 19,2020 at 08:12:44 UTC from IEEE Xplore. Restrictions apply.
SACI 2020 • IEEE 14th International Symposium on Applied Computational Intelligence and Informatics • May 21-23 • Timişoara, Romania
000093
Authorized licensed use limited to: University College London. Downloaded on June 19,2020 at 08:12:44 UTC from IEEE Xplore. Restrictions apply.
D. A. Poștovei et al. • The evolution and challenges of modern Distributed Control Systems
B. 2018-RAURENI 220/110 KV SUBSTATION is required in all sectors of the electrical power system,
Scope: Upgrade the existing DCS system; starting with the production sector and continuing with the
Supplier: Areva T&D France; transport and distribution ones.
Network redundancy: Link aggregation and PRP A very important aspect related to a DCS implementation
Implemented communication protocols: Ethernet, in a substation is to use the common automation technologies
IEC 61850, IEC 60870-5-101. available for all the vendors for an easy, compatibility with
Same as in the 2008 architecture, the owner maintained modern IT facilities and a better interface with business and
the design with three DCS levels, finding that at Level 0 were plant management staff.
not need any changes. In addition to the full adoption of a common
The big changes were found at Level 1 and Level 2 of the communication protocol, namely IEC61850, future DCS
new DCS architecture (Figure 6). design must evolve towards a standardization of process
First of all, all the Master-Slave communication architectures and HMI interface technology, to reduce end-
protocols at Level 1 were not present anymore. All IEDs, were user engineering and straining costs.
connected to Ethernet network only by IEC 61850 protocol. Although the progress of DCS systems depends on each
This aspect extends the usage of GOOSE (Generic Object supplier and is achieved in a closed system, a major benefit
Oriented Substation Event) messages from BCUs only in the for the entire industry of DCS will be their evolution towards
old architecture to all IEDs in the new one. open and standardized systems, without the proprietary
Another important aspect is related to high availability of characteristics of the suppliers, which represents a technical
the new network design achieved by using a combination of barrier in the direction of standardization.
Link Aggregation and PRP protocol. As a result, apart from The DCS servers, running the Windows / Linux operating
the having two network interfaces to prevent a single network system, are the focus of the entire set of applications. In order
failure, any device failure will not affect other equipment in to avoid the risks related to the integrity, availability and
the network as in the old architecture. confidentiality of the data, the cyber security of these systems
In the ten years between the two DCS implementation, must be improved and managed by professionals in the field
there was not any change or upgrade in the NCC and not left in the hands of the operational personnel.
communication interface, and the new substation monitoring DCS systems represent today's reality, both in terms of
And control from NCC center is still managed using IEC process monitoring and control and a better interface with
60870-5-101, a Master-Slave communication protocol business and plant management staff.
ADVANTAGES AND DISATVANTAGES OF REFERENCES
IMPLEMENTATION OF MODERN DCS SYSTEMS [1] S. Chowdhury, S.P. Chowdhury and P. Crossley, “Microgrids and
Advantages: Active Distribution Networks”, The Institution of Engineering and
1. High availability due redundancy realized with a Technology, 2009.
[2] https://literature.rockwellautomation.com/idc/groups/literature/docum
combination of RSTP and PRP communication ents/wp/proces-wp010_-en-e.pdf.
protocols; [3] N. Arghira, D. Hossu, I. Fǎgǎrǎsan, S. Iliescu, D. Costianu, “Modern
2. Increased safety operation and protection of the SCADA philosophy in power system operation” - A survey, Buletin
installation against defects, by implementing a stiintific, University POLITEHNICA of Bucharest, Series C nr. 2,
redundant protection system 2018 compared to a 2011.
[4] Stuart A. Boyer - Scada_ Supervisory Control and Data Acquisition,
single one in 2008; ISA 2004.
3. The PRP architecture runs on two independent [5] T. Puzenberger, “Ethernet Network Redundancy in SCADA and real-
networks and therefore can achieve the hot swap time Automation Platforms”, Copa-Data GmbH, White paper 2016.
switching, with the recovery of the [6] B. Camachi, L. Ichim, D. Popescu, “Cyber Security of Smart Grid
communication in 0ms (bump less), of all the Infrastructure”, IEEE 12th International Symposium on Applied
Computational Intelligence and Informatics, SACI 2018, Timisoara,
equipment connected in the DCS network;
Romania.
4. The PRP network architecture continuously [7] R. Botezatu, “Cyber Security for SCADA and DCS systems”, ICARE
monitors the network devices in order to manage Cybersecurity, Germany 2016.
the redundancy and tolerates any defects of the [8] Efacec Automation, Presentation of CLP500 - Substation Automation
network components; System, Buletin de prezentare, Efacec 2013.
5. Very complex communication architectures can [9] R. Gupta, P. Kumar, ‘’ Cloud Computing Data Mining To SCADA for
Energy Management’’, IEEE India Conference (INDICON), New
be realized. Delhi, India, 2015.
6. High interoperability with other communication [10] D. Grozev, G. Spasov, M. Shopov, N. Kakanakov, G. Petrova,
networks; ‘’Experimental Study of Cloud Computing Based SCADA in Electrical
7. Use of a single communication protocol for the Power Systems’’, XXV International Scientific Conference
entire process or plant, respectively IEC 61850. Electronics - ET2016, September 12 - 14, 2016, Sozopol, Bulgaria.
[11] Chen, X., Crossley, P.A., Guo, H., Design, construction and validation
Disadvantages of a next generation protection and control system based on IEC61850
1. Only the cost should be mentioned as the main standards, DPSP 2014, 31 March-3 April 2014, Copenhagen,
disadvantage. It results due to duplication of Denmark.
redundancy equipment, network interfaces, [12] https://en.wikipedia.org/wiki/Distributed_control_system, referred
copper cables, optical fiber, and the associated from figure ''Functional levels of a manufacturing control operation''.
[13] 60870-5-101, First Edition, 1997-12, Telecontrol equipment and
engineering, installation and maintenance costs. systems, Part 5-103, Interface of protection equipment.
[14] 60870-5-101. Second edition. 2003-02. Telecontrol equipment and
V. CONCLUSIONS systems, –. Part 5-101, ftp://preview.iec.ch/preview/info_iec60870-5-
In the current and future socio-economic context, 101%7Bed2.0%7Den.pdf, accessed 05.02.2020.
where a country's progress is closely linked to energy
infrastructure, a large-scale implementation of DCS solutions
000094
Authorized licensed use limited to: University College London. Downloaded on June 19,2020 at 08:12:44 UTC from IEEE Xplore. Restrictions apply.