IEEE-Time Synchronization For Transmission Substations Using GPS and IEEE 1588 (2016)

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 9

CSEE JOURNAL OF POWER AND ENERGY SYSTEMS, VOL. 2, NO.

3, SEPTEMBER 2016 91

Time Synchronization for Transmission Substations


Using GPS and IEEE 1588
Peter A Crossley, Member, IEEE, Hao Guo, Student Member, IEEE, and Zhao Ma, Senior Member, CSEE

Abstract—Time synchronization systems that utilize the global I. I NTRODUCTION


navigation satellite systems (GNSS) are widely used in the mon-
itoring, control, and protection of transmission networks. They
ensure that phasor measurement units (PMUs) can accurately
monitor voltage phase angles, increase the accuracy of fault
I NTELLIGENT electronic devices (IEDs) used in substa-
tions ensure a transmission network operates in a stable
state. But when an abnormal event occurs, the IEDs must
locators, enhance the capabilities of disturbance recorders, and rapidly restore the network from the abnormal state back to
allow differential feeder protection to use re-routable communi- a normal state. An IED measures power system quantities
cation networks. However, concern about the reliability of GNSS
receivers used in intelligent electronic devices (IEDs) have been
(voltage, current, frequency, power, etc.) and the operational
reported; problems include mal-operations of differential protec- states of switches and circuit breakers. This data is processed
tion, erroneous satellite timing/location messages, inappropriate by the local IED and communicated to other IEDs in the
installations, and blocking of satellite signals due to illegal use substation, remote IEDs, network controllers, and/or system
of GNSS jammers in vehicles. operators where further processing and analysis is carried
Utilities now require a timing system less dependent on the out. The resulting knowledge is used by one or more IEDs
use of low cost GNSS receivers integrated into IEDs, but one that
uses Grandmaster clocks, slave and transparent clocks, and an to respond to the event that first triggered the change in
Ethernet communication network. The IEEE 1588-2008 synchro- the measured quantities. The event might be a short-circuit
nization protocol uses the Ethernet to disseminate a global time fault or an extreme overload that should be solved locally,
reference around a substation. A future substation will probably or an event such as switching action, generator or feeder
include duplicate 1588 grandmasters, each incorporating stable tripping, a voltage or frequency excursion, which requires
oscillators with GNSS and terrestrial receivers, in conjunction
with a 1588 compliant Ethernet data network with slave and remote responses. These measurements, acquired in each bay
transparent clocks, and redundancy boxes for interfacing with of each substation, only describe the actual real time operating
IEDs. state of the power system if they are synchronized to a
Although IEEE 1588 protocol is promising for future substa- common time reference.
tion automation systems, its performance and impact has to be
fully evaluated before it can be used in real substations. This
IEDs can be synchronized using either a dedicated timing
paper describes how an IEEE 1588 time synchronization testbed system based on standalone cabling and signal repeaters, or a
is designed, constructed, and tested. Testing involves measuring network timing system shared with other automation applica-
the time offset when the Ethernet is heavily loaded with other tions and normally based on Ethernet cables and switches [1].
traffic and the holdover capability of 1588 clocks. Additional Dedicated timing systems often use one pulse per second
delay introduced by IEEE 1588 traffic is also measured. As there
is limited testing on GPS receivers within the power industry,
(1-PPS) to provide an accurate timing reference at the start
this paper also uses the testbed to evaluate the steady state and of each second, or the IRIG-B time code for time and
transient behavior of GPS receivers. The results show a 1588 time date information. GPS (or GNSS) receivers convert the time
synchronization system is accurate, secure, and ideally suited for information received from GNSS into a 1-PPS signal and
protection and control applications, compared to a timing system the IRIG-B time code, which are then used to synchronize
merely based on GPS receivers. The information described in this
paper should increase a utility’s confidence in applying IEEE
all the IEDs in a substation [2]. An example of a dedicated
1588 timing in a real substation. timing network that operates independent of the substation
communication network is shown in Fig. 1. When the 1-
Index Terms—GNSS, GPS, IEDs, IEEE 1588, substations, time PPS signal travels from the GPS receiver to the device, a
synchronization, transmission networks. propagation delay is introduced. During commissioning, this
delay must be measured and compensated.
Substation applications, such as SCADA or disturbance
recorders, requiring timing accuracy in the millisecond range,
Manuscript received March 11, 2016; revised June 27, 2016; accepted July can use a network time protocol (NTP) system operating over
27, 2016. Date of publication September 30, 2016; date of current version an existing Ethernet communication network, as illustrated in
August 12, 2016.
P. A. Crossley (corresponding author, e-mail: p.crossley@manchester.ac.uk) Fig. 2. However, most substation applications require timing
and H. Guo are with School of Electrical and Electronic Engineering, The accuracies in microseconds and consequently NTP is not
University of Manchester, (Manchester, M13 9PL) UK. suitable. For example, phasor measurement units (PMUs),
Z. Ma is with China Electric Power Research Institute, Bejing 100192,
China. travelling wave fault locators (TWFL) and IEC61850-9-2
DOI: 10.17775/CSEEJPES.2016.00040 sample value merging units (SV-MU) require an accuracy of
2096-0042 
c 2016 CSEE
92 CSEE JOURNAL OF POWER AND ENERGY SYSTEMS, VOL. 2, NO. 3, SEPTEMBER 2016

±1 μs. Whilst current differential protection (CDP) generally II. 1588 T IME S YNCHRONIZATION
requires 20 μs and IEC61850-8-1 GOOSE messaging requires
A. Introduction to 1588 Time Synchronization
accuracy better than 1 ms.
An increasing number of IEDs are using the Ethernet data
GPS clock network for communication purposes [3] and most experts
IRIG-B over coaxial cable
expect Ethernet to become the communication backbone for
future transmission substations. Considering the cost, com-
Protection plexity and reliability, it would be ideal if high accuracy
relays
synchronization can utilize the Ethernet. Unfortunately, an
Substation HMI Ethernet based NTP timing system only achieves 1–4 ms
IEC 61850, FTP,
DNP3, Modbus etc accuracy, which is inadequate for most applications, including
IEC 61850-9-2 SVs, CDP, TWFL, and PMUs. An alternative
Ethernet switch to NTP is the IEEE 1588 timing standard, which operates
over a data network and achieves significantly improved timing
SCADA gateway accuracy. The IEEE 1588-2008 standard (IEEE 1588v2) [4],
also known as the Precise Time Protocol Version 2 (PTPv2),
Fig. 1. Separate timing and communication networks [1]. is an IP/Ethernet based time synchronization protocol that
realizes sub micro-second timing accuracy.
A master-slave IEEE 1588 synchronization network consist-
GPS clock as NTP master ing of different types of IEEE 1588v2 devices is shown in Fig.
3, where each 1588v2 device is referred to as a clock. Four
types of clock are available in IEEE 1588v2 standard [4]:

Other time
Substation HMI NTP Ordinary Clock-1 Ordinary Clock-2 reference
protection (Grandmaster) (Master as backup for Grandmaster)
relays GPS input

Ethernet switch End-to-end transparent


Peer-to-peer
transparent Clock-1 Clock-1 (or non-1588 switch)

SCADA gateway

Fig. 2. Combined timing and communications [1]. Boundary clock

Peer-to-peer End-to-end transparent


The IEEE 1588-2008 (IEEE1588v2) synchronization pro- transparent Clock-2 Clock-2 (or non-1588 switch)
tocol uses a data network to disseminate the time reference
similar to NTP, but delivers timing accuracy better than ±1 μs.
Ordinary Clock-3 Ordinary Clock-4 Ordinary Clock-5
Consequently, IEEE 1588 synchronization is expected to be- (Slave) (Slave) (Slave)
come the preferred choice for future Ethernet based protection
and control systems. However, before it can be applied in a real Fig. 3. Network of IEEE 1588v2 clocks.
substation, various tests should be conducted to help users gain
better insight into the feasibility, performance, and limitations 1) An ordinary clock is an end device and can be a
of the 1588 protocol. Since testing on an Ethernet system in a grandmaster clock for the whole substation, or a master
real U.K. substation is impossible, the aim of this research is to clock if it supplies the time source for other clocks on
build a laboratory based testbed to investigate and evaluate the a single communication path, or a slave clock if it is
performance and impact of an IEEE 1588 timing system. In synchronised by a grandmaster or master clock.
addition, many GPS manufacturers claim their GPS receivers 2) A boundary clock is basically a network bridge or switch
can deliver timing accuracy better than one micro-second, but and is the combination of slave clocks and master clocks.
there are few published data for those used in the power It will act as a slave clock for the connected upstream
industry. Consequently, the performance of GPS receivers is master/grandmaster clock and becomes the master clock
also investigated using the testbed. The goal of this research for its downstream slave clocks. In terms of non-1588
is to help utilities identify the limitations of timing systems messages and IEEE 1588 management messages, the
based on GPS and IEEE 1588, and then develop solutions that boundary clock will forward them as a normal Ethernet
enhance reliability and increase the confidence in applying the bridge or switch. On the contrary, IEEE 1588v2 mes-
technology. sages related to synchronization and clock selection will
This paper is organized as follows. Section II provides terminate in the boundary clock.
background information on IEEE 1588, followed by test 3) An end-to-end transparent clock is a network bridge or
arrangements, results, and discussions in Section III and the switch capable of measuring the time required for a
conclusions in Section IV. 1588 message to pass through the end-to-end transparent
CROSSLEY et al.: TIME SYNCHRONIZATION FOR TRANSMISSION SUBSTATIONS USING GPS AND IEEE 1588 93

clock. In comparison, this clock passes all non-1588 hierarchy can be established and ports in the master state will
packets as a normal bridge/switch. For all 1588 “timing” start to send out 1588 messages. After that, the intermediate
packets, the end-to-end transparent clock measures the IEEE 1588v2 transparent clocks (network bridges/switches
residence time and accumulates the value in a special supporting 1588v2 features) will measure the delay of 1588
field (correctionField) of the IEEE 1588 message. The messages between the port in the master state and the port in
final destination of the message (i.e., a slave clock) can the slave state. This will be used by the port in the slave state
then compensate the residence delay time, as shown in to adjust the clock’s local time. Note: ports in the passive
Fig. 4. state will neither transmit nor receive 1588 messages. Once
the master-slave hierarchy is established, the slave clock(s)
Message at ingress Message at egress will estimate the time offset between itself and the Master
Event message PTP message
payload Network payload Network Clock using data packets containing time information. With
protocol Preamble protocol Preamble reference to Fig. 6; the relationship between timestamps t1
correctionField headers correctionField headers
and t4 is:
+

+ t1 + time offset + propagation delay = t4 (1)


Ingress timestamp Egress timestamp time offset = t4 − t1 − propagation delay (2)
 +
Ingress Egress
Residence time bridge
Hence, it is necessary to measure the propagation delay be-
Fig. 4. End-to-end transparent clock measuring 1588 message residence fore calculating the time offset. When using 1588v2 in power
time [4]. industry, the IEEE 1588 Power Profile [6] specifies the use
of Peer Delay Request-Response to measure the propagation
4) A peer-to-peer transparent clock is a network bridge delay. More specifically, this measures the propagation delay
or switch with the ability to measure the residence between the Master port and associated Slave port(s) using the
time of an IEEE 1588 message and the delay of the messages “Sync, Pdelay Req and Pdelay Resp” as shown in
link on which the receiving port locates. Similarly, the Fig. 6. If a 1-step clock is used, there is no Follow Up and
peer-to-peer transparent clock will forward all non-1588 Pdelay Resp Follow Up message. If a 2-step clock is used, a
messages as a normal bridge/switch. For specific 1588 Follow Up and a Pdelay Resp Follow Up are required. A 1-
packets, the peer-to-peer transparent clock will measure step clock measures the actual time t1 when the Sync message
the residence time and link delay and then update the is sent out and encapsulates the precise timestamp in the
value of the “correctionField” so that the receiver of the Sync message. Whilst the 2-step clock only packs a coarse
messages (i.e., a slave clock) can compensate for both timestamp in the Sync message and the actual time is carried
the switching delay and the path delay. The residence in the associated Follow Up message later.
time and link delay measurement model of a peer-to-
The synchronization process using the Peer Delay Request-
peer transparent clock is shown in Fig. 5.
Response mechanism is described below:

GPS timing source 1) Master clock generates the Sync message and transmits
path + residence time correctionField
it; the time t1 when the Sync message is sent out is
carried in Sync message (or in the Follow Up message).
2) When a Sync message arrives at a peer-to-peer trans-
parent clock, timestamp t2 is recorded by the clock
Transparent clock Slave
Master
- Peer to peer delay mechanism
as the ingress timestamp. When the Sync message is
- Master clock is synchronized
with clock source measures path propagation time forwarded, timestamp t3 is generated as the egress times-
- Transparent clock measures
residence and path delay
tamp. The time difference between t3 and t2 is the resi-
Industrial Ethernet
dence time that is accumulated in the correctionField of
Fig. 5. Peer-to-peer transparent clock measuring 1588 message residence Sync (or Follow Up). The peer-to-peer transparent clock
time and path delay [5]. also accumulates the link delay in the correctionField
of Sync. If there are multiple peer-to-peer transparent
B. Working Principle of 1588v2 clocks, the residence time and link delay measurement
and accumulation process is repeated in each clock.
The 1588v2 synchronization process requires the selection
3) Slave clock receives the Sync message (and Follow Up
of the grandmaster or master used to synchronize the slaves
message), records the receiving time t4 , and extracts the
and subsequently the establishment of master-slave hierarchy.
timestamp t1 and correctionField data.
The best master clock algorithm defined in [4] can determine
which clock in the network is the best clock so that it can Once the slave clock receives the sending and receiving
be selected as the grandmaster clock. The best master clock timestamps with propagation delay of Sync, it can calculate
algorithm can then determine the state of each port (i.e., the time offset between the master clock and the slave clock.
master, slave or passive) on a clock. Once the clock selection Finally, once the time offset is calculated, the local time of
and state determination are accomplished, the master-slave the slave clock is adjusted to follow the master clock time.
94 CSEE JOURNAL OF POWER AND ENERGY SYSTEMS, VOL. 2, NO. 3, SEPTEMBER 2016

Pdelay_Req ts1 Initially,


slave time = master time + time offset
ts2 Pdelay_Req ts5 Clock output:
ts3 Pdelay_Resp
ts6 1-PPS or IRIG-B
ts4 ts7 Pdelay_Resp
Pdelay_Resp_Follow_Up ts8

Sync Pdelay_Resp_Follow_Up
t1
Port in Master t2 Peer-to-peer Port in Slave
state Follow_Up transparent state
clock t3 Sync Timestamps known by Slave Clock
t4 t4, also t1 if 1-step Master in use
ts9 Pdelay_Req Follow_Up t1, t4
ts10
Pdelay_Resp ts11 ts13 Pdelay_Req
ts12 ts14
Pdelay_Resp ts15
Pdelay_Resp_Follow_Up
ts16
Pdelay_Resp_Follow_Up

correctionField of Sync / Follow_Up =


fractional ns = CF0

correctionField of Sync / Follow_Up =


CF0 + linkDelay 1 = CF1

correctionField of Sync / Follow_Up =


CF1 + residenceTime = CF2

correctionField of Sync / Follow_Up =


CF2 + linkDelay 2

Fig. 6. Peer delay request-response mechanism.

C. Previous Application and Research of IEEE 1588 A hardware testbed integrating IEEE 1588 and IEC 61850
was set up during the UCAIug Network Interoperability
In China, IEEE 1588 has been employed in real substations
Demonstrations at CIGRE 2012 [9]. It was reported that
since December 2009 and details of network design and
good interoperability between different vendors was achieved
engineering are provided in [7]. However, no results on the
(detailed results were not published); however, utilities may
performance of IEEE 1588 timing have been given.
not obtain sufficient confidence on IEEE 1588 timing because
IEEE 1588 devices including clocks and Ethernet switches the testing period was too tight.
from various manufacturers with power profile were tested
In Australia, a full IEEE 1588 hardware testbed with Peer
in the IEEE 1588 power profile plugfest hosted by the IEEE
Delay Request-Response mechanism was built in 2012 [10].
Power & Energy Society (PES) Power System Relaying Com-
Test results indicated that timing accuracy better than 500
mittee (PSRC) in early 2010 . Results indicated the achievable
ns could be obtained when three transparent clocks were
timing accuracy was in the range between a few hundred
used between grandmaster and slaves. However, all tests were
nano-seconds and a few micro-seconds when there was no
conducted with no background traffic and the testing period
other traffic in the network. It was also discovered the best
was only 1800 s, which was relatively short.
master clock algorithm would select a non-qualified clock as
Therefore, this paper expands the research work by inte-
the grandmaster clock during the transient state. The report
grating assessment of long-term stability of GPS receivers and
also suggested a multi-vendor testbed would be useful in
IEEE 1588 slaves and investigation of impact of IEEE 1588
identifying implementation issues.
traffic on network latency.
Authors in [8] integrated IEEE 1588 timing in a real
substation automation system in Italy in 2011. In this system,
the Ethernet switches did not support 1588 and the delay
request-response mechanism had to be used instead of the III. P ERFORMANCE A NALYSIS FOR GPS & 1588 T IMING
Peer Delay Request-Response mechanism that is specified by
A. Timing Stability of GPS
the 1588 power profile. Experimental results showed the time
of the slave clock drifted even when the background traffic The timing system for a transmission substation needs
only occupied 1% of the bandwidth. It was advised that IEEE to maintain a high level of accuracy over a long period.
1588v2 Ethernet switches would be necessary to achieve sub However, direct use of GPS is now considered unreliable
micro-second timing accuracy. because of problems related to climatic conditions and signal
CROSSLEY et al.: TIME SYNCHRONIZATION FOR TRANSMISSION SUBSTATIONS USING GPS AND IEEE 1588 95

interference. Hence, it is necessary to investigate the long- an increased mask angle can improve the timing accuracy by
term time differences when using different GPS receivers. This reducing the occurrence of spikes in the timing signal.
is critically important since automation systems use phasor A reason for the time offset spikes is the location of a
measurement information from widely separated substations high wall to the south of the GPS antennas. Results indicate
and this relies on time references derived from different GPS satellites are lost at the southern edge and the signal quality
receivers. might not be sufficient for ideal synchronization; see Fig. 9.
The laboratory system used for measuring the time offset
between different GPS receivers is shown in Fig. 7. One of
the GPS receivers is selected as the reference and its 1-PPS
is used as the reference input to the measurement server. The
other GPS receivers, A and B, also feed their own 1-PPS to
the measurement server. The server then measures the time
difference between the rising edge of the 1-PPS from reference
GPS receiver and receiver A and B under test. Note that the
mask angle for GPS signal reception is only configurable on
GPS receiver A and the device manual suggests increased
mask angle reduces the field of view and lowers the timing
Fig. 9. Log of GPS satellites using reference receiver.
error caused by multi-path satellite signals situated low in the
sky.
According to Fig. 10, the accuracy of the 1-PPS from
receiver B is worse than receiver A; occasionally the time
1-PPS Measurement
GPS Antenna server
offset of GPS receiver B exceeds the threshold value ±1 μs,
which might lead to mal-operation if an application requires
1-PPS 1-PPS an accurate time reference from multiple GPS receivers. The
minimum and maximum time offset of receiver B measured
Reference GPS during the tests are −677 ns to 1372 ns.
GPS Antenna receiver
Time Offset for GPS Receiver B
1500
1400 Receiver B with unconfigureable mask angle
GPS receiver A 1200
1000
Time Offset (ns)

800
GPS Antenna 600
400
200
0
GPS receiver B −200
−400
−600
Fig. 7. Measurement of time offset between receivers. −800
−1000
0 10,000 20,000 30,000 40,000 50,000 60,000
The time offset between GPS receiver A and reference GPS Time (s)
receiver is shown in Fig. 8, and Fig. 10 shows the time offset
Fig. 10. Time offset between receiver B and reference.
between receiver B and the reference. The time offset for
receiver A is always significantly less than ±1 μs and the time
offset spikes are reduced when the mask angle is increased. B. Timing Stability of IEEE 1588 Synchronization System
More specifically, the minimum offset value is −379 ns and
Unlike direct use of GPS, 1588 timing relies on a wired
the maximum value is 456 ns when the mask angle is less
data network to accomplish time synchronization within a
than 8◦ . When the mask angle is increased to above 15◦ , the
substation. This means it is more controllable as the data
timing offset varies between −346 ns to 318 ns. This verifies
network can be carefully designed, engineered and monitored
so that it could always operate correctly.
Time Offset for GPS Receiver A The lab setup to measure the time offset between the
900
800 Receiver A with 5 degree mask angle reference GPS receiver (1588 grandmaster) and the 1588
700 Receiver A with 8 degree mask angle
600 Receiver A with 15 degree mask angle slaves is indicated in Fig. 11. The reference GPS receiver can
500
Time Offset (ns)

Receiver A with 20 degree mask angle


400 transmit 1588 timing packets as well as output 1-PPS to the
300 measurement server. The 1588 slaves are synchronized and
200
100
0
then feed 1-PPS to the measurement Server for time offset
−100
−200
measurement. The Grandmaster and Slave clocks use the 1588
−300 Power Profile and all Ethernet switches utilize the Peer Delay
−400
−500 Request-Response Mechanism as required by the 1588 Power
0 5,000 10,000 15,000 20,000 25,000 30,000 35,000 40,000 45,000
Time (s) Profile. The background traffic in the data network occupies
85% of the bandwidth and is multicast traffic with priority
Fig. 8. Time offset between receiver A and reference. 4. The bandwidth of the network is 100 Mb/s. Note: 1588
96 CSEE JOURNAL OF POWER AND ENERGY SYSTEMS, VOL. 2, NO. 3, SEPTEMBER 2016

Power Profile requires the worst-case time offset to be less C. Resynchronization of GPS Timing
than ±1 μs with a network load up to 80% of total bandwidth
and the priority of 1588 traffic is 4. In a real substation, a local clock may lose global/national/
regional synchronization due to a power supply failure or the
GPS Antenna loss of an external synchronization signal. For example, U.K.
1-PPS
Measurement
server National Grid reported a number of differential protection mal-
1-PPS
1-PPS operations resulting from corruption of the 1-PPS output of
GPS receivers upon GPS restoration. To understand the issue,
1588 switch 1588 switch 1588 switch
Grandmaster (peer-to-peer (peer-to-peer (peer-to-peer Slave Clock-1 the test facility shown in Fig. 7 is used to monitor the behavior
clock
(reference
transparent
clock)
transparent
clock)
transparent
clock) Slave Clock-2 of two GPS Receivers after the loss of GPS synchronization
GPS receiver) and then its subsequent restoration. To emulate the loss of the
1588 network
GPS signal, the GPS Antennas connected to receivers A and
Fig. 11. Measurement of time offset between 1588 grandmaster and 1588 B are temporarily disconnected. The measurement results are
slaves. illustrated in Fig. 13 and 14. When receiver A loses the GPS
signal, the time offset between itself and the reference GPS
The measured time offsets for both 1588 Slave clocks are receiver drifts at 2 ns/s. The mask angle of receiver A is 20◦
shown in Fig. 12. The offsets are always less than ±150 ns and the worst-case initial time offset is 150 ns. Therefore,
and the fluctuation is significantly less than achieved with in- receiver A can maintain micro-second accuracy for 425 s.
dividual GPS receivers. Note: during the measurement period, When receiver A regains GPS signal, an 8 μs timing spike
a single 1588 packet is randomly lost due to deficiencies in in the time offset occurs and its duration is several seconds.
the Ethernet switch. However, the 1588 slaves always maintain This could cause a problem for an IED if precise timing is
synchronization. required [2].

Time Offset for 1588 Slaves


200 Time Offset for GPS Receiver A
1588 Slave C 2,000
150 1588 Slave D 1,000
0
100
Time Offset (ns)

Time Offset (ns)

−1,000
50 −2,000
−3,000
Loss of GPS
0 −4,000
Restoration of GPS
−5,000
−50 −6,000
−7,000
−100 −8,000
−150 −9,000
0 5,000 10,000 15,000 20,000 25,000 30,000 35,000 40,000 −10,000
0 100 200 300 400 500 600 700 800 900
Time (s)
Time (s)

Fig. 12. Time offset between 1588 slaves and grandmaster.


Fig. 13. Receiver A time offset: loss and recovery of GPS.

The results presented in this paper demonstrate IEEE 1588


delivers long term timing accuracy within ±150 ns when 1588 When receiver B loses the GPS signal, the time offset
Power Profile is enabled on 1588 Grandmaster and Slave between itself and the reference receiver drifts at 1.33 ns/s.
clocks and all Ethernet switches support 1588 Peer Delay When GPS synchronization is restored, Receiver B recovers
Request-Response mechanism, regardless of the network load synchronization very quickly, and no significant time offset
(85% bandwidth in this test) and the loss of 1588 packets. The spike is observed. Hence, the transient performance of receiver
variation in the timing accuracy is −79 ns to 107 ns for slave B is acceptable for IEDs that require precise timing.
C and −109 ns to 72 ns for slave D.
In comparison, conventional GPS timing system delivers Time Offset for GPS Receiver B
inferior long term timing accuracy as factors such as signal 600
interference, antenna positions, and system installation tech- Loss of GPS
niques degrade the performance of the system. The situation 400
Time Offset (ns)

often becomes worse when a large number of distributed GPS


antennas and receivers are used and each IED obtains the 200

time signal from its own GPS Receiver. In addition, the clock
adjustment algorithm used in different GPS receivers is not 0
Restoration of GPS
the same, and in some cases the time offset between GPS
receivers can fail to satisfy the ±1 μs requirement. However, −200
0 100 200 300 400 500 600 700
when 1588 timing is used, only one GPS receiver operates as Time (s)
the 1588 grandmaster for the whole substation at any point in
Fig. 14. Receiver B time offset: loss and recovery of GPS.
time, and all 1588 Slaves follow this grandmaster and deliver
±1 μs accuracy more easily.
CROSSLEY et al.: TIME SYNCHRONIZATION FOR TRANSMISSION SUBSTATIONS USING GPS AND IEEE 1588 97

D. Resynchronization of 1588 Timing Two extremely important components of the network traffic
The test facility shown in Fig. 11 is used to investigate how are the IEC 61850 9-2 sample values (SV) and the IEC 61850
1588 slave clocks behave when 1588 timing packets are lost GOOSE messages. These maintain the correct operation of the
and then recovered. The loss is emulated by disconnecting the primary plant used in a substation and ensure the power system
1588 slaves from their adjacent Ethernet switches. The impacts operates in a stable state. As defined in the IEC 61850 stan-
on slave C and D are shown in Fig. 15 and 16 respectively. dards and IEEE 1588 Power Profile, 1588, SV and GOOSE
When slave C is disconnected from the data network, it drifts traffic all have the same priority value of 4. This means a
at 0.8 ns/s, resulting in a 1 μs accuracy holdover time of particular packet from any of these sources would be randomly
about 1116 s. Once the connection is restored and it starts to placed in the output queue as shown in Fig. 17, which means
receive the 1588 packets, it immediately synchronizes to the the residence time within a switch is un-deterministic. If a
grandmaster. In comparison, when slave D is disconnected, 1588 Ethernet switch is used, un-deterministic residence time
it drifts at −3.6 ns/s and the holdover time is about 248 s. values will not affect the 1588 timing accuracy since the
Again, it rapidly synchronizes to the grandmaster when the delays are measured and compensated and this is previously
communication is restored. proved by the tests described in Section B. However, a data
packet such as a SV message is very sensitive to the network
Time Offset for 1588 Slave C latency [11]. Hence, it is necessary to investigate how the 1588
150
Recovery of 1588 Packets traffic affects the data traffic from other applications that share
100 the same Ethernet network.
Time Offset (ns)

50 8
7
Loss of 1588 Packets 6
0 5 61850 9-2 SV
4
−50 3 with priority = 4
2
1588 1
−100 Mixed traffic
0 100 200 300 400 500 with priority = 4
Time (s) Switch

Fig. 15. Time offset slave C: Loss-recovery 1588 packets.


87 6 5 4 3 2 1
2 6 2 5 4 1 3 1 2 1
1
Time Offset for 1588 Slave D 2
100 3 61850 GOOSE
Loss of 1588 Packets 4
5 with priority = 4
0 6
7
Time Offset (ns)

−100
Fig. 17. Interaction of traffic with same priority.
−200

−300 The test setup illustrated in Fig. 18 is used to investigate the


Recovery of 1588 Packets impact of 1588 traffic on the latency of SV packets through
−400
0 100 200 300 400 500 600 700 an Ethernet switch. The grandmaster injects 1588 messages
Time (s) into the switch with a rate up to 128 packets/s and the
latency of SV packets can be measured under various 1588
Fig. 16. Time offset slave D: Loss-recovery 1588 packets.
traffic load conditions. More specifically, a MU produces the
SV stream which will be copied by an Ethernet tap before
Based on these observations, re-synchronization of 1588 entering the 1588 switch. The copied SV packet is captured
timing ensures 1588 slave clocks follow the grandmaster in
a fast and secure manner. In comparison, restoration of the
GPS signal in a conventional GPS receiver might introduce a
time offset spike that corrupts the output of the receiver and Wiring Legend
could cause mal-operation of an IED. Original SV stream Grandmaster clock
Copied SV stream (1588 traffic generator)
1588 traffic
E. Impact of 1588 Traffic Capture
card
The IEEE1588 protocol uses data packets within an Ethernet 1588 switch
network to disseminate the time reference from the grand- MU Ethernet tap
T2
master. Sharing an Ethernet network between 1588 traffic
and traffic related to other IED applications can result in
an inevitable interaction. This might affect a critical IED T1
especially if the traffic is not carefully managed and the
network is not appropriately engineered. Fig. 18. Measurement of latency of SV packets.
98 CSEE JOURNAL OF POWER AND ENERGY SYSTEMS, VOL. 2, NO. 3, SEPTEMBER 2016

and timestamped by an Ethernet capture card at T1 . After the ease of maintenance and replacement. However, if high timing
original SV packet is sent out from the switch, it is captured accuracy (< 1 μs) is required from IEEE 1588, two extra
and timestamped by the capture card at T2 . Hence, the latency requirements are required, which significantly increase the
of a SV packet is (T2 −T1 ). The measurement error introduced capital cost: all Ethernet switches must be 1588 compliant and
by the Ethernet tap and the capture card is < ±60 ns, which additional 1588 slave clocks are required to translate 1588 and
is negligible for the network latency measurement. provide 1-PPS and IRIG-B signals for non-1588 IEDs.
The measurement results are shown in Fig. 19; the average In comparison with timing approaches directly using 1-PPS
latency for a SV packet is about 18 μs. This is because the and/or IRIG-B from GPS receivers, 1588 timing over a fully
size of the SV packet from the MU is 141 bytes or 1128 bits compliant 1588 network has the following advantages: better
and the transmission delay within the switch is 1128/(100 × long term accuracy; no time offset spike when synchronization
106 ) = 11.28 μs @ 100 Mb/s. According to IEC 61850-90- is restored; correct operation under heavy network load con-
4 [12], there is a minimum switching delay of 8 μs within an ditions and during the loss of 1588 packets; negligible band-
Ethernet switch and thus the total latency for a SV packet is width consumption and negligible impact on sample values or
about 19.28 μs, which is similar to the measurement results. GOOSE messages. In conclusion, time synchronization system
It is also observed latency can increase to about 24 μs when based on IEEE 1588 is an ideal method for accurate timing
there is no 1588 traffic. The reason is that an Ethernet switch of IEDs in a transmission substation.
has to periodically send a bridge protocol data unit (BPDU)
according to the Ethernet standard [13]. A BPDU contains 64
bytes or 544 bits, which causes additional latency of 544/(100 R EFERENCES
× 106 ) = 5.44 μs @ 100 Mb/s if it is transmitted before a [1] D. Ingram and B. Smellie. (2014, Oct.). Solving electrical substation
SV packet. timing problems: A white paper on the use of the precision time protocol
for substation protection and control systems. [Online]. Available: http://
SV Latency Within an IEEE 1588 Ethernet Switch under Different 1588 Traffic www.chronos.co.uk/files/pdfs/tek/SOLVING ELECTRICAL
0.020 SUBSTATION TIMING PROBLEMS.pdf
0.018 SV latency without 1588 traffic [2] W. An, N. Tart, D. Barron, M. Bingham, and A. Hackett, “A transmission
0.016 SV latency with 96 Sync/second utility’s experience to date with feeder unit protection systems,” in 2012
0.014 SV latency with 128 Sync/second International Conference on Developments in Power Systems Protection
Density

0.012 (DPSP), 23–26 Apr. 2012, pp. 1–6.


0.010 [3] C. Strauss. Practical Electrical Network Automation and Communica-
0.008 tion Systems. Oxford, UK: Newnes, 2003.
0.006 [4] IEEE Standard for a Precision Clock Synchronization Protocol for
0.004 Networked Measurement and Control Systems, IEEE Standard 1588TM -
0.002 2008, 2008.
0 [5] Siemens AG. IEEE 1588 precision time synchronization solution for
1818.5 1919.5 2020.5 21 21.5 2222.5 23 23.5 2424.5 2525.5 2626.5 2727.5 28 28.5 2929.5 30 electric utilities. [Online]. Available: http://w3.siemens.com/mcms/
Latency (μs) industrial-communication/en/rugged-communication/technology-
highlights/ieee-1588-precision-time-synchronization-solution-for-
Fig. 19. Impact of 1588 on SV latency. electric-utilities/Pages/ieee-1588-precision-time-synchronization-
solution-for-electric-utilities.
[6] IEEE Stanadard Profile for Use of IEEE 1588 Precision Time Protocol
When 1588 traffic is present in the network, the maximum in Power System Applications, IEEE Standard C37.238-2011, 2011.
latency for a SV packet increases from 24 μs to 29 μs. [7] R. Moore, R. Midence, and M. Goraj, “Practical experience with IEEE
Considering a 1588 Sync message contains 72 bytes or 576 1588 high precision time synchronization in electrical substation based
on IEC 61850 process bus,” in 2010 IEEE General Meeting, July 2010,
bits, the transmission latency is thus 576/(100 × 106 ) = pp. 1–4.
5.76 μs. 29 μs indicates a BPDU and a 1588 message are [8] C. M. De Dominicis, P. Ferrari, S. Rinaldi, and M. Quarantelli, “On
transmitted before a SV packet. Consequently, if 1588 traffic the use of IEEE 1588 in existing IEC 61850-based SASs: Current
behavior and future challenges,” IEEE Transactions on Instrumentation
shares the data network with critical automation applications, and Measurement, vol. 60, no. 9, pp. 3070–3081, Sep. 2011.
it will introduce additional delay of about 5.76 μs at a data [9] M. Goraj, H. Kirrmann, R. Mackiewcz, and C. Hoga. (2012, Dec.).
rate of 100 Mb/s or 0.576 μs at 1000 Mb/s. This has to be UCAIug at CIGRE 2012. PAC World. [Online]. December 2012 Issue
(Industry Reports). Available: https://www.pacw.org/no-cache/issue/
considered when planning and designing the data network. december 2012 issue/industry reports/do we have a conscience. html
[10] D. M. E. Ingram, P. Schaub, and D. A. Campbell, “Use of precision time
protocol to synchronize sampled-value process bus,” IEEE Transactions
on Instrumentation and Measurement, vol. 61, no. 5, pp. 1173–1180,
IV. C ONCLUSION May 2012.
Centralized time synchronization based on the IEEE1588 [11] Communication Networks and Systems for Power Utility Automation –
Part 5: Communication Requirements for Functions and Device Models,
protocol has numerous advantages, including: the ability to IEC 61850-5: 2013 (E), 2013.
use high quality antennas and receivers; simplified installa- [12] Communication Networks and Systems for Power Utility Automation
tion requirements; automatic compensation of the propagation – Part 90-4: Network Engineering Guidelines, IEC 61850-90-4: 2013,
2013.
delay from the time reference; removal of the need for [13] IEEE Standard for Ethernet – Section 1, IEEE Standard 802.3-2015,
manual measurement of signal delay; operation over general 2016.
substation Ethernet network; removal of the need to construct a
dedicated time distribution network; reduced requirements on
number of output modules on GPS receivers; future scalability;
immunity to GPS synchronization degradation and loss; and
CROSSLEY et al.: TIME SYNCHRONIZATION FOR TRANSMISSION SUBSTATIONS USING GPS AND IEEE 1588 99

Peter A. Crossley (M’95) received the B.Sc. degree Zhao Ma rreceived the B.Eng. degree from Xian
from UMIST, Manchester, U.K., in 1977 and the Jiaotong University in 1982 and the Ph.D. degree
Ph.D. degree from the University of Cambridge, from the Staffordshire University, U.K., in 1996. He
U.K., in 1983. He is a Professor of electrical power is National Distinguished Expert of “1000 Elite Pro-
systems engineering at the University of Manchester, gram” and Chief Expert – Smart Power Distribution
U.K. and Director of the EPSRC Centre for doctoral of China Electric Power Research Institute (CEPRI).
training in power networks. He has published over He is CEng. FIET, current CIGRE China and the
250 technical papers on protection and is an active Asia Pacific Region SC6 Chairman. His main work
member of CIGRE, IEEE and IET. areas include: smart distribution network planning
and asset management; intelligent T&D equipment,
in particular for design and development; technical
consulting; and MVDC and Energy Internet.

Hao Guo (S’12) received the B.Eng. degree from the


University of Manchester, Manchester, U.K. in 2012.
He is currently a Ph.D. student at The University of
Manchester. His research interests include time syn-
chronization, Ethernet redundancy and engineering
within power substations.

You might also like