PROTECTION PERFORMANCE TESTING IN IEC 61850
BASED SYSTEMS
Li Yang*, Peter Crossley*, Xin Sun**, Miles Redfern**, Wen An , Henri Grasset
*The University of Manchester, U.K.; li.yang-3@postgrad.manchester.ac.uk, p.crossley@manchester.ac.uk
* *University of Bath, U.K.; xs210@bath.ac.uk, M.A.Redfern@bath.ac.uk
'National Grid , U.K.; wen.an@uk.ngrid.com
"Areva T&D, France; henri.grasset@areva-td.com
Keywords: lEC 61850, Protection schemes, Performance
testing.
Abstract
IEC 61850 offers significant advantages when compared
against other substation communication protocols; in
particular the replacement of analogue and binary signals with
Ethernet messages reduces the cost of the system and
improves flexibility and functionality. However, it also
requires a new type of test bench suitable for the functional
and performance testing of IEC 61850 compatible protection
relays and systems. Test sets used in such applications need to
have the functionality to perform coordinated and precisely
synchronised tasks as a part of a distributed, system wide test
facility.
Methods for testing conventional protection relays will be
reviewed and some of the issues that affect how we test the
next generation of relays will be discussed; the paper will also
investigate new approaches for testing IEC 61850 compatible
relays based on the Real Time Digital Simulator (RTDS) and
the OMICRON test set. The structure and implementation of
a new RTDS system based on IEC 61850 standard are
proposed. A test model connecting the RTDS system and the
secondary digital devices will be presented.
1 Introduction
The widely deployment of Intelligent Electronic Devices
(lED), such as non-conventional instrument transformers
(NCIT, optical voltage and current transformers) and digital
relays, has facilitated the implementation of next-generation
protection systems. The digital output signals of NCIT work
as the input signals for the digital relays through a process bus
based on IEC 61850-9-2 standard. The process bus
technology shows how NCIT break the constraints of
conventional CTs and VTs. It enables the use of a digital link
between electronic current/voltage transformers or merging
units (MUs) and bay devices such as protective relays, bay
controllers or meters [1].
As the international standard for communications in
substations, the key feature of IEC 61850 is its
t tt
comprehensive formal description of the substation
automation system and the relationship of its functions to the
single line diagram representing the primary equipment
provided by System Configuration Language (SCL). It
provides a very high potential both for testing and
maintenance of the system over its complete life-cycle.
Protection performance testing plays a very important role in
the electric power system engineering, because it ensures that
the protection functions implemented in relays of different
types are going to operate as designed in order to ensure the
fastest possible fault clearing. This paper will review the
features of testing for conventional protection relays. New
approaches based on RTDS system and OMICRON test set
for IEC 61850 compatible relays will be investigated.
2 Review of conventional testing
Generally, all testing improves the quality and reduces risks
both for the suppliers and consumers. Traditionally relays are
tested by injecting signals, to check their current, voltage and
contact input hardware, to check that the measuring elements
and scheme logic are operating correctly, to check that their
settings are correct, and to check the contact output hardware.
For substation automation, testing from device to system
levels was described, analysed and summarised in the Cigre
report 236 [2] . This report was used as input for IEC 618750-
10 defining conformance testing, but its content covers more
than what are included in the standard. Detailed conformance
testing procedures are issued and test centers were qualified
by UCA International Users Group - Subgroup Testing [3].
This Cigre report also discusses the difference between
product/device, system and project related testing.
The R&D Testing sequence should start from Device Type
Test, followed by the Integration Test and end with the
System Test. The Conformance Test is the type test for
standards like IEC 61850 for communication. Successful
Type Tests are the prerequisite to start the Integration Test,
where the new product is tested in a small fixed test system.
For conventional testing the test device has to simulate the
substation process through hard-wired interface between the
analogue and binary outputs of the test device and the
analogue and binary inputs of the test object. At the same
time the test device has to monitor the relay outputs of the test
object in order to detect the operation of the lED and analyse
it to determine if the performance meets the specification. The
operating time is usually measured by the test device from the
simulated process change of state that has to trigger the tested
function until the moment when it detects the operation of the
lED relay output controlled by the tested function.
Traditionally protection test procedures are based on the use
of test switches (e.g. FT switches); but that such test switches
are impractical with process bus applications. Analogue and
contact signals accessed by traditional methods via test
switches are remote from the relay location, and are
distributed throughout the substation. If test switches were to
be placed on the merging unit/process equipment interface,
impractically long testing leads would be required to establish
connection to a conventional test set. In addition there could
be technical and safety problems due to the noise induced in
such leads. Fortunately, test switches can and should be
designed out of schemes employing microprocessor-based
equipment, as is explained in reference [4]. The same
argument applies to process bus schemes. When test switches
are designed out, it is of course necessary to use new
procedures adopting the advanced capabilities of modem
protection equipment instead of test switches - this applies
equally for process bus systems where such switches are not
feasible.
Conventional protection technologies provided for test polices
that allows protection of a single zone to be isolated, safely
modified, re-tested and restored while the protection for other
zones remains in-service and unaffected. For the most part,
this could be done without having to remove the protected
power equipment from service, relying on redundant
protection. To gain acceptance, protection systems based on
process bus technology will have to provide equivalent or
better capability in these areas.
3 Impact of lEe 61850 on relay testing
The implementation of IEC 61850 in the substation can be
defined as partial, hybrid and complete. Partial
implementation is defined as the case that the lED supports
only station bus communications, while the analogue signals
are based on conventional hard wmng. Hybrid
implementation is the case that the lED has process and
station bus interface, but the execution of the trip function is
based on hard wires between the relay outputs and the breaker
trip coil. Complete implementation means that the lED has
communication based interface only. The difference between
the complete implementation and the hybrid case is that
tripping is achieved by a GOOSE message sent to the breaker
control device that performs the actual breaker tripping [5].
Test sets used in such applications are required to have the
functionality to perform coordinated and precisely
synchronised tasks as a part of a distributed, system wide test
facility.
The utilisation of system configuration information, the
GOOSE mechanism, Sampled Values and Client/Server
SCADA Communication introduce several new issues for
testing the next generation of relays. The most obvious
change is the different way of wiring to obtain the signals.
The availability of machine readable, system wide
configuration information enables new, automated procedures
for the configuration of tests.
The system configuration language implemented by IEC
61850 standard defines a file format that describes the
components of the substation and the protection and
automation system in a way that allows most of the
engineering tasks to be performed automatically.
OMICRON test sets are very well adopted in protection
relays testing. It utilise the NetSim Software (Network
Simulator) , which provides predefined Test Cases and
Network Configurations to perform the tests. Standard
network configurations with a simple parameter setup allow
instant "click and run" simulations with signal outputs via the
test set. Fig. 1 shows the utilisation of system configuration
information for testing a "stand-alone" relay.
System
Configurator
Fig. 1. Usage of configuration information for testing
By " wiring" protective relays and test sets through the
substation network, the test configuration is just transformed
into the networked world. Fig. 2 shows a simplified, "fully­
networked" protection testing layout based on a complete
implementation oflEC 61850.
GOOSE
Protection
Relay
SV (Sampled Values)
____-L__________ ____________�________
Fig. 2. "Fully Networked" protection testing
The test equipment can be connected to the GOOSE massages
and the feedback from and stimulus to the devices under test
that was formerly exchanged via binary 1I0s, can be
established by wiring the test equipment to the substation
network. This test equipment is able to simulate the merging
units by generating Sampled Values and publishing them on
the network to be subscribed by the devices under test.
This networked testing system appears not have changed very
much compared with the classical testing of protection
functions. The protection functions of the relays still work in
the same way. For example, testing a distance protection will
be performed by using the exact same fault scenarios and
assessment criteria as before. Many aspects of the test
configuration can be efficiently supported by using the
substation configuration information.
It is important that a test system preserves the working
environment from classical testing and allows the re-use of
existing test procedures for use with IEC 61850.
In addition, the substation devices provide a lot of additional
information to be used for SCADA purposes. With IEC
61850, these data are all served in a standardised way. By
using a generic tool that works with relays, a tester may easily
look up some additional status data (e.g. specific pick-up
information). This will provide extended depth of testing.
System tests were and are already performed to a certain
extent. Prominent examples are the End-to-End tests for
sophisticated line protection schemes. With the availability of
substation wide configuration data, the feasibility of tests
involving more devices is very much facilitated. Test with
multiple points of test signal injection and measurement of
response will become more easily to implement in IEC 61850
installations. New application approaches of the Real Time
Digital Simulator (RTDS) in IEC 61850 based systems will
be presented in next section.
4 Application of the RTDS in lEe 61850
compatible relay testing
The Real Time Digital Simulator (RTDS) is a fully digitised
electromagnetic transient power system simulator for use to
conduct close-loop testing of physical devices such as
protection equipment and control equipment; to perform
analytical system studies and to educate operators, engineers
and students [6-9].
It is a combination of advanced computer hardware and
comprehensive software. The RTDS employs an advanced
and easy to use single line diagram user interface - the
RSCAD Software Suite. The software is comprised of several
modules designed to allow the user to perform the simulation
and result analysis. All loading, running and controlling of the
simulation is done entirely from the host workstation through
the RSCADlRunTime module.
The most important point is the fact that the RTDS works in
continuous, sustained real time. That is, it can solve the power
system equations fast enough to continuously produce output
conditions that realistically represent conditions in the real
network. The simulator can be connected directly to power
system control and protective relay equipment and adjust its
calculations based on their operation. It is a cost-effective
substitution for transient network analysers and
analogue/hybrid simulators. The RTDS allows the user to
investigate the effects of disturbances on power system
equipment and networks and consequently prevent blackouts.
4.1 Conventional RTDS testing system
Fig. 3 demonstrates the application of RTDS in the
conventional analogue signal based system. The RTDS
simulates the power system and generates the required
voltages and currents signal to the amplifiers through a D/A
converter. The RTDS also exchanges the circuit breaker
status, relay trip and re-c1osure signals with the conventional
protectivelED under test via a binary 110 interface.
The amplifier receives low level signals from the RTDS and
amplifies them to a level compatible with the input module of
the relays. The amplifier is composed of some analogue
components which are not only very large in size, but also
very expensive since it has to have the ability to carry high
currents and voltages. As a result, only a limited number of
relays can be connected to a RTDS system at one time
through the amplifiers, this constrains the capability of a
RTDS system for relay testing.
Breaker Status and Control Breaker Status and Control
,..... _ .................. _..j... .............................................................. .. ................................,
FLTBUS REBUS
Fig. 3. Simulation system based on analogue signals
4.2 Design of a new RTDS testing system.
A significant advantage of the IEC 61850 system compared
with the conventional system is the replacement of analogue
and binary signals with Ethernet messages. Merging Unit
(MU) works as an access from the instrument transformers to
the digital ports of relays through Ethernet utilising a specific
data format in accordance with IEC 61850 protocols.
The simulation data generated by the RTDS can be injected to
the IEC 61850 compatible relays by a data format conversion.
This is achieved by introducing a "Conversion Interface
Module". There is no need for the D/A interface unit and the
current and voltage amplifiers any more. Fig.4. is a schematic
diagram of RTDS close-loop testing design.
Breaker Control Signals
Digital Voltage/Current
Monitoring
Signals
Fig. 4. Schematic diagram of RTDS close-loop testing design.
This conversion interface module (CIM) has the ability to
access the digital simulation signals generated by the RTDS
directly and converts these data to an IEC 61850 compatible
format. These data can now be injected to the Protective lED
for testing purpose.
The connection between the RIDS system and the CIM can
be configured as analogous to accommodate the existing
testing system as an intergradation phase. Otherwise, this
connection can be configured as digitised which means there
is a direct connection between the RTDS system and the CIM.
Fig. 6. RIDS based test system using GTNET
This is shown in Fig. 5.
Fig. 5. Connection diagram between RTDS system and CIM
4.2 Implementation of this new RTDS testing system.
The Giga-Transceiver Network Communication Card
(GTNET) adopted in RTDS can provide real time
communication to and from the simulator via Ethernet.
Different firmware versions are used to accommodate IEC
61850 GSE binary messaging, IEC 61850-9-2 sampled
values, playback of large data files stored on a PC hard disk
and DNP communication (SCADA protocol commonly used
in substations).
As shown in Fig. 6, the simulated data (digital signals)
generated by the RTDS system are transferred to the
GTNET_SV card, where the data are sampled, time-stamped
and converted to a IEC 61850 compatible format and
broadcasted to the Ethernet. The subscribed device is able to
access its required data from the Ethernet. This effectively
eliminates the D/A interface and the current and voltage
amplifiers. It is worth noting that, for protective relays that
need more than one current or voltage sampled values, every
node involved requires a GTNET_SV card installed.
The GTNET_GSE card has the function to exchange breaker
status and substation control signals. It supports both GOOSE
and GSSE messages but can not support them simultaneously.
In the GOOSE mode, an lED configuration file ( * .scd) is
generated to configure the GTNET card using the substation
configuration language. The configuration information can be
inputted to the GTNET card directly in the GSSE application.
Breaker Status and Control Breaker Status and Control
Igna
j
r------------------------ -- --- -------------------------- ------------------------------ -- --- -------------
FlTBUS REBUS !
Now with process bus, the relay has no physical current,
voltage or contact inputs, so there is no corresponding
hardware to check. The hardware performing a somewhat
analogous function, the optical transceivers, PRY chip, etc.,
are continuously self-tested with signal level margin detectors
and with data security codes (Le. CRC), so there is little if any
value in further testing the relay's process bus input/output
hardware. The firmware that implements the measuring
elements and scheme logic is continuously checked again by
CRC, and the processors by watchdog timers.
5 Further discussion
Once the testing is complete, it is necessary to restore the
relay to service in a safe and secure way. It is necessary to
avoid the trap of closing a switch, make a connection, or
restore a mode that results in undesired action such as tripping
a circuit breaker.
Communications system testing issues such as LAN
congestion, correctness of LAN configuration settings
required to automatically re-route around failed switches,
non-deterministic latency, etc should be involved in relay
injection testing in the IEC 61850 based systems. It is very
important to ensure that there is a continuous optical path
from each port of the relay to/from the correct merging unit,
and that path losses leave adequate signal margin. As the
optical transceivers at both ends are equipped with
diagnostics that continuously measure the send and receive
light levels even while the link is in normal operation. The
relay then generates alarms should any level fall out of operational characteristics," IEEE Trans. on Power Delivery,
tolerance. Establishing the correct operation of these alarms pp.447-452, 1999.
should be part of the relay injection testing and the merging [9] Dingxiang Du, Z Q Bo, Zexin Zhou, A Perks, L Denning,
unit/primary equipment testing as well. B Smith, "An Advanced Real Time Digital Simulator Based
Test System for Protection Relays", 41st University Power
Engineering Conference, UPEC2006, Northumbria
4 Conclusions University, Newcastle upon Tyne, September 2006

With the availability of substation wide configuration data,

tests involving multiple devices (e.g. interoperability test) are
very much facilitated. Tests involving several points of signal
injection and the measurement of overall scheme response
will become easier to implement in IEC 61850 installations.

New significantly simplified and cost-effective test scheme

based on RTDS can be achieved and presented; more relays
and their associated protection schemes can be tested
simultaneously due to elimination of voltage and current
amplifiers. The personnel and equipment safety hazard can be
reduced as well.

The criteria for selecting appropriate test schemes can be

concluded. This should take into account factors such as the
scope of system under test, the requirement of extensive real
time interaction, the ranges of test volts and amps and the
number of logical and output signals that need to be
monitored. An optimised test scheme layout is able to be
delivered by configuring the test sets according to the test
objectives.

References

[1] Communication networks and systems in substation-Part

9-2: Specific communication service mapping (SCSM)­
Sampled analogue values over ISO 8802-3, IEC Std. 61850.
[2] Conformance testing guideline for communication in
substations - Cigre Report 236 (produced by SC B5 WG
B5.01) 2003
[3] UCA International Users Group-
http://www.ucainternational.org
[4] S.Fulford, M.Thompson, "An Examination of Test
Switches in Modern Protection and Control Systems"
Proceedings of the 34th Annual Western Protective Relay
Conference, Spokane, WA, 2007.
[5] A. Apostolov, B. Vandiver, " Testing requirements for
IEC 61850 based devices", Power Systems Conference:
Advanced Metering, Protection, Control, Communication,
and Distributed Resources, 2007, PSC 2007.
[6] R. Kuffel, J. Giesbrecht, T. Maguire, R.P. Wierckx, P.
McLaren, "RTDS - A Fully Digital Power System Simulator
Operating in Real Time", First International Conference on
Digital Power System Simulators, ICDS-95, College Station
TX, USA April 1995.
[7] M. Kezunovic et. aI., "Digital simulator performance
requirements for relay testing," IEEE Trans. on Power
Delivery, VoU3, No.1, pp.78-84, January 1998.
[8] L. A. Kojovic and T. R. Day, "Application of real-time
power system simulators for testing protective relay system