Comparison of State Estimation Process

on Transmission and Distribution Systems

M. S. N. G. Sarada Devi(&) and G. Yesuratnam

Electrical Department, Osmania University, Hyderabad, Telangana, India

sarada216@gmail.com, ratnamgy2003@gmail.com

Abstract. This paper focuses on State Estimation (SE) process on transmission

network and distribution network. State estimation obtains laudable data from
the raw data supplied by measurement meters which are distributed in the
network for available network model. This information is used in on-line
monitoring and analyses of the network/system. This paper provides detailed
comparison of state estimation process on transmission systems and on distri-
bution systems in 9 different points. This paper also focuses on how measure-
ment Jacobian matrix is changing in Distribution System State Estimation
(DSSE).

Keywords: Power system state estimation

Transmission System State Estimation and Distribution System State Estimation

Measurement Jacobian

1 Introduction

System operating conditions monitoring is a continuous process for secure and unin-
terrupted operation of power systems to meet the consumer’s demand. In this con-
nection different measurement meters (analog and logic/digital) are placed in different
places in the entire system. The raw data given by these meters through RTU is
transmitted to the energy management system. Power System State Estimation (PSSE)
is one of the EMS functions which have been known as basis of EMS.
SE is the process of obtaining system variables for given network model and
measurements acquired from the system. Logic measurements are used to determine
the system configuration and analog measurements are used to obtain the state vari-
ables. Detailed information about Transmission System State Estimation (TSSE) (like
TSSE observability methods, available state estimator methods and bad data process) is
given in [1–24]. Coming to distribution systems, load flow program is used for plan-
ning purpose. But now- a-days distribution automation also requires estimate of the
system state. Detailed information about Distribution System State Estimation (DSSE)
is given in [25–64].
However, to the best of our knowledge no paper is available on comparison of SE
process on transmission and distribution systems. This paper focuses on this gap and
provides the survey of state estimation process on transmission systems and on dis-
tribution systems. This paper also explains measurement Jacobian matrix in both the
systems.
© Springer Nature Switzerland AG 2020
S. C. Satapathy et al. (Eds.): ICETE 2019, LAIS 4, pp. 414–423, 2020.
https://doi.org/10.1007/978-3-030-24318-0_50
 Comparison of State Estimation Process on Transmission and Distribution Systems 415

2 Significance of Power System State Estimation

The creditable data (each bus voltage magnitude and phase angle) obtained from state
estimation is utilized by other EMS functions like contingency analysis, optimal power
flow and security enhancement, limit checking program and economic dispatch etc. It is
shown in Fig. 1.

Fig. 1. Significance of PSSE

3 Power Systems State Estimation Functions

The power system state estimation (simply State Estimation) process has following
functions:
1. Network Topology Processor (NTP)
2. Network Observability Analysis (NOA)
3. SE solution algorithm
4. Bad data processing
The CB’s on/off information is given to NTP to form one line diagram of the
network. Available measurements set and network configuration is considered in NOA.
The Measurements set is added by pseudo measurements if network is unobservable
with the available measurements. In SE solution algorithm, state variables are obtained.
Any bad data in measurements is detected, identified and eliminated in bad data pro-
cessing. Each function is explained clearly in [1].
416 M. S. N. G. Sarada Devi and G. Yesuratnam

Figure 2 shows block diagram of power system state estimation process.

Fig. 2. Block diagram of PSSE process

4 SE Process on Transmission Networks

Transmission networks are more meshed typed and over-determined (number of

available measurements are more than number of state variables).
A. SE process on transmission networks:

1. Transmission Network Topology process:

Based on the status data about CB and switches stored in database, one line
diagram of the system is configured.
2. Observability Analysis:
Algorithm for observability analysis can be either topological or numerical method.
The measurement Jacobian matrix in TSSE is given in Eq. (1). Numerical method is
widely used method for network observability analysis of the system.
2 @ ðPinjÞ @ ðPinjÞ 3
@h @V
6 @ ðP flÞ 7
6 @ ðP flÞ 7
6 @h @V 7
6 7
6 @ ðQinjÞ @ ðQinjÞ 7
H¼6
6 @h @V 7
7 ð1Þ
6 @ ðQ flÞ @ ðQ flÞ 7
6 @h @V 7
6 7
4 @ ðVmagÞ @ ðVmagÞ 5
@h @V
:
 Comparison of State Estimation Process on Transmission and Distribution Systems 417

3. SE solution algorithm:
A power system state estimator based on the Weighted Least Square (WLS) method
is the most known. Detailed explanation of WLS method is given in [3].
4. Bad data processing in TSSE:
In bad data analysis, usually chi-square test for detecting bad data and largest
normalized residual test for identifying bad data are performed (Table 1).

Table 1. SE process on transmission networks

Function Widely used method
NTP Based on changes in Ybus
NOA Numerical method
SE solution algorithm (widely WLS–bus voltages as state variables
used)
Bad data process Chi-square test for detection largest normalized residual
test for identification
Parameter and structural error Based on changes in Ybus
processing

5 SE Process on Distribution Networks

A. Challenges in DSSE:
Fundamentally the distribution network characteristics hold opposing views to that
of transmission network (and it is tabulated in Table 2), DSSE facing following
challenges.
1. Conventional methods cannot be used directly
2. Requires assumptions and modifications either in configuration or methods.
3. Measuring meters are very few.
4. Depending on pseudo measurements
5. Low accuracy of pseudo measurements.
6. Difference in the time references of real-time data.

B. Measurement Data in DSSE:

As number of meter points is much lower in distribution network, most of the
measurements data used in DSSE are pseudo measurements data.
Real-Time Data:
a. Voltage magnitude and phase angle at feeder bus and real and reactive power of the
feeder.
b. Customer smart meters report demand data.
418 M. S. N. G. Sarada Devi and G. Yesuratnam

Pseudo Data:
a. Pseudo power injection measurements at feeder buses.
b. Customer billing data.
c. Typical historical load profiles.

C. SE process on distribution networks:

1. Distribution Network Topology Process:
Object oriented approach is used in NTP. The changes in the system state are
identified by autonomous network operation with SE and automatically update the
system model.
2. Observability Analysis
Algorithm for observability analysis can be either topological or numerical method.
3. SE solution algorithms in DSSE
Weighted Least Square (WLS) method with branch-currents as state variables is
widely used method.
4. Bad data processing in DSSE
In bad data analysis, usually chi-square test for detecting bad data and largest
normalized residual test for identifying bad data are performed.

Table 2. Characteristics of distribution network

Transmission N/W Distribution N/W
Construction Meshed type Radial type
Redundancy No. of meter points are No. of meter points are much lower
more
Available V, Pinj, Qinj at buses, Pfl, Qfl Power or current injections at feeders,
Measurements of branches very few branch currents
Load Phase Balanced type Unbalance type
R/X ratio Low High

The measurement Jacobian matrix in DSSE is given in Eq. (2). Numerical method
is widely used method for network observability analysis of the system (Table 3).
 Comparison of State Estimation Process on Transmission and Distribution Systems 419

2 3
@ ððIinjÞeq of PinjÞ @ ððIinjÞeq of PinjÞ
@Ir @Im
6 7
6 @ ððI flÞeq of PflÞ @ ððI flÞeq of PflÞ 7
6 7
6 @Ir @Im 7
6 @ ððIinjÞeq of QinjÞ @ ððIinjÞeq of QinjÞ 7
H¼6
6
@Ir
@ ððI flÞeq of Q flÞ
@Im
@ ððIflÞeq of Q flÞ
7
7 ð2Þ
6 @Ir @Im 7
6 7
6 @ ðVmagÞ @ ðVmagÞ 7
4 @Ir @Im 5
@ ðIflÞ @ ðIflÞ
@Ir @Im

*Note: eq of means equivalent of

Table 3. SE process on distribution networks

Function Widely used method
NTP Object oriented approach [37]
NOA Numerical method
SE solution algorithm (widely WLS–branch currents as state variables
used)
Bad data process Chi-square test for detection largest normalized residual
test for identification
Parameter and structural error Based on changes in Ybus
processing

6 Comparison of TSSE and DSSE

Transmission System State Estimation and Distribution System State Estimation are
compared in nine points and those are listed in Table 4. From the Table 4 it is clear
that, accuracy of the DSSE is mainly depends on available historical/forecasted data of
demand/load. If pseudo measurements accuracy increases, accuracy of state estimator
also increases.
In TSSE, direct measurement partial differentiator (∂x) are used to form mea-
surement Jacobian matrix where as in DSSE, considered measurements are first con-
verted into equivalent current measurements. Later these measurements partial
differentiator (∂x)eq are used to form measurement Jacobian matrix.
In DSSE, branch-currents chosen as state variables to increase the estimator
accuracy and reduce the calculations complexity.
420 M. S. N. G. Sarada Devi and G. Yesuratnam

Table 4. Comparison of TSSE and DSSE

TSSE
(i) State variables:
X = [v, ø] in polar form
X = [Vr, Vi] in rectangular form
In TSSE nodal voltage based state vector is
considered in polar form to reduce the
calculations complexity
(ii) Pseudo measurements:
All measurements except critical
measurements. Some of the available
measurements are also comes under pseudo
measurements
(iii) Types of measurements:
Voltage magnitude, real/reactive power
injections/flows
(iv) Measurements used in Jacobian
matrix:
V, Pinj, Qinj, Pfl, Qfl
Voltage magnitude, real/reactive power
injections/flows. These measurements are
used to form H
(v) H in TSSE: Mostly used form is polar
form. It is given in Eq. (1)
(vi) Only un available data are calculated
(vii) Weighted Least Square method with
nodal voltages as state vector in polar form is
mostly used to obtain the state variables
(viii) Observability analysis and bad data
process can be done easily because available
measurements are more. Mostly used method
is numerical method
(ix) TSSE is more accurate
DSSE
(i) State variables:
(a) in branch current based method:
X = [Ir, Im] in rectangular form
X = [i, ø] in polar form
(b) in nodal voltage based method:
X = [v, ø] in polar form
X = [Vr, Vi] in rectangular form
(ii) Pseudo measurements:
These are obtained from the historical
information of the powers drawn by the loads.
Pseudo measurements do not exist physically
(iii) Types of measurements:
Voltage magnitude, real/reactive power
injection at substation, very few branch
currents and real/reactive power of the loads
(iv) Measurements used in Jacobian
matrix:
Ireal, Iequ
All power measurements are converted into
equivalent current measurements and those
are used along with available substation
voltage equivalent current and few current
measurements to form H
(v) H in DSSE: Mostly used form is
rectangular form. It is given in Eq. (2)
(vi) Unavailable and available data (load
data) are calculated
(vii) Weighted Least Square method with
branch currents as state vector in rectangular
form is mostly used to obtain the state
variables
(viii) Observability analysis and bad data
process is difficult because available
measurements are very few. Mostly used
method is numerical method
(ix) DSSE is less accurate

7 Conclusions

State estimation provides creditable data from raw data supplied by the measurement
devices which are distributed in the network for available network model. This
information is used in on-line monitoring and analyses of the network/system. This
paper provides detailed comparison of state estimation process on transmission systems
 Comparison of State Estimation Process on Transmission and Distribution Systems 421

and on distribution systems. This paper also focuses on how measurement Jacobian
matrix is changing in Distribution System State Estimation (DSSE). Here all power
measurements are converted into equivalent current measurements and those are used
along with available substation voltage equivalent current and few branch current
measurements to form the measurement Jacobian matrix H.

References
1. Schweppe F, Rom D (1970) Power system static-state estimation: parts I, II, & III. IEEE
Trans Power Apparatus Syst 89(1):125–130
2. Costa I, Leao J (1993) Identification of topology errors in power system state estimation.
IEEE Trans Power Syst 8(4):1531–1538
3. Wu FF (1990) Power system state estimation: a survey. Int J Electr Power Energy Syst 12
(2):80–87
4. Monticelli A (1999) State Estimation in Power Systems: A Generalized Approach. Kluwer,
Norwell
5. Abur A, Expsito AG (2004) Power System State Estimation: Theory and Implementation.
Marcel Dekker, New York
6. Filho M, Leite da Silva A, Falcao D (1990) Bibliography on power system state estimation
(1968–1989). IEEE Trans Power Syst 5(3):950–961
7. Monticelli A (2000) Electric power system state estimation. Proc IEEE 88(2):262–282
8. Zarco P, Gomez-Exposito A (2000) Power system parameter estimation: a survey. IEEE
Trans Power Syst 15(1):216–222
9. Do Coutto Filho MB, De Souza JCS (2009) Forecasting-aided state estimation: parts I & II.
IEEE Trans Power Syst 24(4):1667–1677
10. Arefi A, Haghifam M-R (2011) Smart Power Grids. Springer, Cham, pp 439–478
11. Huang Y-F, Werner S, Huang J, Kashyap N, Gupta V (2012) State estimation in electric
power grids: meeting new challenges presented by the requirements of the future grid. IEEE
Signal Process Mag 29(5):33–43
12. Liu W-H, Wu F, Lun S-M (1992) Estimation of parameter errors from measurement
residuals in state estimation [power systems]. IEEE Trans Power Syst 7(1):81–89
13. Liu W-H, Lim S-L (1995) Parameter error identification and estimation in power system
state estimation. IEEE Trans Power Syst 10(1):200–209
14. Alsac O, Vempati N, Stott B, Monticelli A (1998) Generalized state estimation. IEEE Trans
Power Syst 13(3):1069–1075
15. Castillo E, Conejo A, Pruneda R, Solares C (2005) State estimation observability based on
the null space of the measurement Jacobian matrix. IEEE Trans Power Syst 20(3):1656–
1658
16. Nian-De X, Shi-Ying W, Er-Keng Y (1982) A new approach for detection and identification
of multiple bad data in power system state estimation. IEEE Trans Power Apparatus Syst
101(2):454–462
17. Monticelli A, Garcia A (1983) Reliable bad data processing for realtime state estimation.
IEEE Trans Power Apparatus & Syst 102(5):1126–1139
18. Koglin H-J, Neisius T, Beiler G, Schmitt K (1990) Bad data detection and identification.
Int J Electr Power Energy Syst 12(2):94–103
19. Chen J, Abur A (2006) Placement of PMUs to enable bad data detection in state estimation.
IEEE Trans Power Syst 21(4):1608–1615
20. Singh D, Misra R, Singh V, Pandey R (2010) Bad data pre-filter for state estimation. Int J
Electr Power Energy Syst 32(10):1165–1174
422 M. S. N. G. Sarada Devi and G. Yesuratnam

21. Garcia A, Monticelli A, Abreu P (1979) Fast decoupled state estimation and bad data
processing. IEEE Trans Power Apparatus Syst 98(5):1645–1652
22. Falco D, Bezerra U (1991) Power system operating state forecasting for security analysis
applications. Int J Electr Power Energy Syst 13(6):330–336
23. Shih K-R, Huang S-J (2002) Application of a robust algorithm for dynamic state estimation
of a power system. IEEE Trans Power Syst 17(1):141–147
24. Blood EA, Krogh B, Ilic, M (2008) Electric power system static state estimation through
Kalman filtering and load forecasting. In: 2008 IEEE power and energy society general
meeting, July 2008, pp 1–6
25. Singh R, Pal B, Jabr R (2009) Choice of estimator for distribution system state estimation.
IET Gener Transm Distrib 3(7):666–678
26. Roytelman I, Shahidehpour SM (1993) State estimation for electric power distribution
systems in quasi real-time conditions. IEEE Trans Power Deliv 8(4):2009–2015
27. Baran M, Kelley A (1995) A branch-current-based state estimation method for distribution
systems. IEEE Trans Power Syst 10(1):483–491
28. Lu C, Teng J, Liu W-H (1995) Distribution system state estimation. IEEE Trans Power Syst
10(1):229–240
29. Meliopoulos AS, Zhang F (1996) Multiphase power flow and state estimation for power
distribution systems. IEEE Trans Power Syst 11(2):939–946
30. Lin WM, Teng JH (1996) Distribution fast decoupled state estimation by measurement
pairing. IEE Proc Gener Transm Distrib 143(1):43–48
31. Lin W-M, Teng J-H, Chen S-J (2001) A highly efficient algorithm in treating current
measurements for the branch-current-based distribution state estimation. IEEE Trans Power
Deliv 16(3):433–439
32. Baran M, Kelley A (1994) State estimation for real-time monitoring of distribution systems.
IEEE Trans Power Syst 9(3):1601–1609
33. Ghosh A, Lubkeman D, Jones R (1997) Load modeling for distribution circuit state
estimation. IEEE Trans Power Deliv 12(2):999–1005
34. Singh R, Pal B, Jabr R (2010) Distribution system state estimation through gaussian mixture
model of the load as pseudo-measurement. IET Gener Transm Distrib 4(1):50–59
35. Thukaram D, Jerome J, Surapong C (2000) A robust threephase state estimation algorithm
for distribution networks. Electr Power Syst Res 55(3):191–200
36. Teng JH (2002) Using voltage measurements to improve the results of branch-current-based
state estimators for distribution systems. IEE Proc Gener Transm Distrib 149:667–672
37. da Silva AL, Do Coutto Filho MB, De Queiroz JF (1983) State forecasting in electric power
systems. IEE Proc Gener Transm Distrib 130(5):237–244
38. Meliopoulos APS, Cokkinides G, Huang R, Farantatos E, Choi S, Lee Y, Yu X (2011) Smart
grid technologies for autonomous operation and control. IEEE Trans Smart Grid 2(1):1–10
39. Pau M, Pegoraro P, Sulis S (2013) Efficient branch-current-based distribution system state
estimation including synchronized measurements. IEEE Trans Instrum Meas 62(9):2419–
2429
40. Korres G (2011) A distributed multiarea state estimation. IEEE Trans Power Syst 26(1):73–84
41. Kekatos V, Giannakis G (2013) Distributed robust power system state estimation. IEEE
Trans Power Syst 28(2):1617–1626
42. Dzafic I, Gilles M, Jabr R, Pal B, Henselmeyer S (2013) Real time estimation of loads in
radial and unsymmetrical three-phase distribution networks. IEEE Trans Power Syst 28
(4):4839–4848
43. Gómez-Expósito A, de la Villa Jaén A, Gómez-Quiles C, Rousseaux P, Cutsem TV (2011)
A taxonomy of multi-area state estimation methods. Electr Power Syst Res 81(4):1060–1069
 Comparison of State Estimation Process on Transmission and Distribution Systems 423

44. Gomez-Exposito A, Abur A, de la Villa Jaen A, Gomez-Quiles C (2011) A multilevel state

estimation paradigm for smart grids. Proc IEEE 99(6):952–976
45. Abbasi AR, Seifi AR (2013) A new coordinated approach to state estimation in integrated
power systems. Int J Electr Power Energy Syst 45(1):152–158
46. Hayes B, Hernando-Gil I, Collin A, Harrison G, Djokić S (2014) Optimal power flow for
maximizing network benefits from demandside management. IEEE Trans Power Syst 29
(4):1739–1747
47. Meliopoulos A, Polymeneas E, Tan Z, Huang R, Zhao D (2013) Advanced distribution
management system. IEEE Trans Smart Grid 4(4):2109–2117
48. Vargas A, Samper M (2012) Real-time monitoring and economic dispatch of smart
distribution grids: High performance algorithms for DMS applications. IEEE Trans Smart
Grid 3(2):866–877
49. Haughton D, Heydt G (2013) A linear state estimation formulation for smart distribution
systems. IEEE Trans Power Syst 28(2):1187–1195
50. Song I, Yun S-Y, Kwon S, Kwak N (2013) Design of smart distribution management system
for obtaining real-time security analysis and predictive operation in Korea. IEEE Trans
Smart Grid 4(1):375–382
51. Deshmukh S, Natarajan B, Pahwa A (2014) State estimation and voltage/VAR control in
distribution network with intermittent measurements. IEEE Trans Smart Grid 5(1):200–209
52. Baran M, McDermott T (2009) Distribution system state estimation using AMI data. In:
2009 IEEE/PES power systems conference and exposition, PSCE 2009, March 2009, pp 1–3
53. Arritt RF, Dugan R, Uluski R, Weaver T (2012) Investigation load estimation methods with
the use of AMI metering for distribution system analysis. In: 2012 IEEE rural electric power
conference (REPC), April 2012, pp B3-1–B3-9
54. Lopez G, Moreno J, Amaras H, Salazar F (2014) Paving the road toward smart grids through
large-scale advanced metering infrastructures. Electr Power Syst Res 120:194–205
55. Alam S, Natarajan B, Pahwa A (2014) Distribution grid state estimation from compressed
measurements. IEEE Trans Smart Grid 5(4):1631–1642
56. Sun H, Gao F, Strunz K, Zhang B (2013) Analog-digital power system state estimation
based on information theory: parts I & II. IEEE Trans Smart Grid 4(3):1640–1655
57. Hippert H, Pedreira C, Souza R (2001) Neural networks for shortterm load forecasting: a
review and evaluation. IEEE Trans Power Syst 16(1):44–55
58. Manitsas E, Singh R, Pal B, Strbac G (2012) Distribution system state estimation using an
artificial neural network approach for pseudo measurement modeling. IEEE Trans Power
Syst 27(4):1888–1896
59. Wu J, He Y, Jenkins N (2013) A robust state estimator for medium voltage distribution
networks. IEEE Trans Power Syst 28(2):1008–1016
60. Hayes B, Prodanovic M (2014) Short-term operational planning and state estimation in
power distribution networks. In: CIRED 2014 workshop, Rome, Italy, June 2014
61. Hayes B, Gruber J, Prodanovic M (2014) A closed-loop state estimation tool for MV
network monitoring and operation. IEEE Trans Smart Grid 6(4):2116–2125
62. Choi S, Kim B, Cokkinides G, Meliopoulos APS (2011) Feasibility study: autonomous state
estimation in distribution systems. IEEE Trans Power Syst 26(4):2109–2117
63. Singh R, Manitsas E, Pal B, Strbac G (2010) A recursive bayesian approach for identification
of network configuration changes in distribution system state estimation. IEEE Trans Power
Syst 25(3):1329–1336
64. Zhi Z, Min L, Shiyu X (2012) A survey on state estimation algorithm of distribution grid. In:
2012 IEEE Proceedings of the spring congress on engineering and technology (S-CET), May
2012