Recurrence Quantification Analysis As A Novel LC Feature Extraction Technique For The Classification of Pollution Severity On HV Insulator Model

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 9

3376 A. K. Chaou et al.

: Recurrence Quantification Analysis as a Novel LC Feature Extraction Technique

Recurrence Quantification Analysis as a Novel LC Feature


Extraction Technique for the Classification of Pollution
Severity on HV Insulator Model
A. K. Chaou, A. Mekhaldi and M. Teguar
Laboratoire de Recherche en Electrotechnique
Ecole Nationale Polytechnique d’Alger
10 Avenue Hassen Badi, B.P 182, El-Harrach, 16200 Algiers, Algeria.

ABSTRACT
Recently, Recurrent Plot (RP) was introduced to study Leakage Current (LC) for
polluted insulator performance monitoring. Based on complex graphical representations,
RP only provides a qualitative overview of the insulator state. To overcome this issue, we
present in this paper a novel technique, named Recurrence Quantification Analysis
(RQA) able not only to indicate RP structures, but also to quantify LC dynamics during
the contamination process. RQA is introduced to investigate RP structures, quantify LC
dynamics and extract features from LC waveforms for polluted insulator monitoring and
performance diagnostic. For this purpose, LC acquisition is firstly carried out on a plan
insulator model uniformly polluted with saline solution. Eight RQA indicators are
presented to investigate LC waveforms under various pollution conductivities. Finally,
mean values of RQA indicators are proposed as input for three well-known classification
methods (K-Nearest Neighbors, Naïve Bayes and Support Vector Machines) in order to
classify the contamination severity into five classes. Results show excellent correlation
between RQA indicators and the pollution severity level.
Index Terms - Leakage current, recurrent plot, recurrence quantification analysis,
feature extraction, polluted insulator monitoring, classification methods.

1 INTRODUCTION amplitude of LC and the total harmonic distortion as


IN order to improve power networks reliability, many characteristic parameters to assess polluted insulators state. To
researches are focused on High Voltage Insulators. This determine LC characteristics, the Fast Fourier Transform
important element of the electrical transmission and (FFT) analysis, power spectrum analysis and wavelet analysis
are used respectively by Suda [9], Song and Choi [10], Douar
distribution system remains, yet, vulnerable to various
et al [11] and Pylarinos et al [12]. As main result found by
environmental conditions. Indeed, high voltage insulators are
Suda, magnitudes of 3rd, 5th and 7th harmonics
susceptible to electrical flashover occurrence under natural (corresponding to 50 Hz, 150 Hz and 250 Hz respectively)
and industrial pollution [1-3]. To examine this phenomenon, increase within the flashover process. Wavelets are useful for
many authors studied the effect of pollution accumulation on decomposing LC into low frequency, medium frequency and
the insulator surface and found that the Leakage Current (LC) high frequency components. According to Song et al [10], the
is closely related to the contamination level [4-19]. high frequency components of LC are helpful to monitor the
To predict the contamination level and monitor high voltage contamination process on HV insulators. Also, Douar et al
insulators, several methods, known as feature extraction [11] analyzed the flashover process and examined the
techniques, have been developed to study the characteristics of frequency characteristics of LC using Standard Deviation-
LC. Ramirez-Vazquez et al [6] were interested to measure the Multi Resolution Analysis (STD-MRA) representation.
pulse number and the peak value of LC as well as the Recently, Pylarinos et al [12] compared classification
cumulative charge value to assess pollution severity. performance of LC waveforms for temporal and frequency
Similarly, Li et al [7] highlighted the mean value, the features. Results showed that frequency components provide
maximum value and the standard deviation of the LC as better results. However, classical LC feature extraction,
suitable quantities to study LC under pollution conditions. computed from temporal and frequency domains, are very
Moreover, Jiang et al [8] proposed to examine the phase angle limited in number. Moreover, interpretation of LC temporal
between LC and applied voltage, the maximum pulse and frequency features does not offer an overview about the
insulator performance. These features have to be used as
Manuscript received on 8 September 2014, in final form 14 April 2015,
inputs of artificial intelligence tools, such as Artificial Neural
accepted 12 June 2015. Networks [13-18] or Fuzzy Logic [19-20], in monitoring of
pollution severity and diagnostic of the insulator performance.

DOI: 10.1109/TDEI.2015.004921

Authorized licensed use limited to: ULAKBIM UASL ISTANBUL TEKNIK UNIV. Downloaded on May 01,2021 at 18:51:23 UTC from IEEE Xplore. Restrictions apply.
IEEE Transactions on Dielectrics and Electrical Insulation Vol. 22, No. 6; December 2015 3377

The Recurrent Plot (RP) is recently introduced in this area. RQA indicators are studied. Two dimensional scatter plots of
Initially, this technique was conceived to detect non-linearities these eight indicators point out the high correlation between
and eventually chaotic dynamics in experimental signals in their mean values and the pollution conductivity value.
physics [21], in financial data time series [22] and ecosystem Consequently, these mean values are used as inputs for three
time series [23]. Recently, it has been successfully applied to well-known classification algorithms (K-Nearest Neighbors,
study LC and monitor the flashover process [24-25] and also Naïve Bayes, Support Vector Machines), while the output is
to Dynamic Drop Test for Hydrophobicity Evaluation of the pollution conductivity value class. As a novel LC feature
Silicone Rubber Insulator [26]. According to these studies, RP extraction technique, RQA seems to be a very effective
provides a rapid overview about the insulator state during the technique not only to monitor and diagnose the insulator
contamination process. However, RP delivers only a performance, but also to study LC dynamic under pollution.
qualitative overview, based on complex graphical
representation that requires tedious interpretation work. 2 EXPERIMENTAL ARRANGEMENT
Besides, an investigation of LC waveforms during the Experiments were carried out using the experiment
contamination process shows that the LC is sinusoidal for low arrangement shown in Figure 1. It comprises a High Voltage
pollution levels [24]; the higher the pollution level, the more Test Transformer (300 kV/50 kVA, 50 Hz) supplied by a
distorted the LC waveform. This latter contains large peaks Regulating Transformer (220/500 V, 50 kVA, 50 Hz). The
and differs from its sinusoidal shape during the discharge applied voltage is recorded through an AC capacitive voltage
propagation until flashover [25]. Such change in LC shape divider (the ratio is 1000:1). The laboratory model is
should suggest the use of non-linear methods to investigate constituted by a glass plate (500 mm x 500 mm x 5 mm).
and control LC dynamic variation during the contamination Made up of aluminum paper, two rectangular electrodes (500
process. mm x 30 mm x 0.003 mm) have been used on both HV and
RQA is one of non-linear methods able to study the ground sides. The distance between the two electrodes
dynamic of a given signal based on the chaos theory [27]. This represents the leakage path of the 1512 L cap and pin insulator
theory claims that small differences in initial conditions, of a (292 mm).
given system, yield widely to diverging outcomes, causing The contaminating pollution is composed of distilled water
thus the output prediction very difficult in general [28]. Used and NaCl and is uniformly and continuously spread all over
numerously in the medical domain to analyze the dynamic of the model surface. To ensure good reproducibility of the
physiological systems [29-39], RQA allows to discern pollution, the saline solution is pulverized 25 times on each
between healthy and unhealthy patients. RQA applied to the side of the insulator model using a sprayer placed above this
heart beat signal revealed successful monitoring of heart model and at a distance of 50 cm from it, as shown in Figure
diseases [29-31]. Electromyography (EMG), which represents 2. To reproduce the different levels of the outdoor insulators
the electrical activity of a muscle during contraction, was pollution (from light to extreme pollution conditions), the
investigated through RQA [32-33]. For instance, RQA has adopted pollution conductivity values are: 0.01, 0.19, 0.71, 1.2
been used by Ito et al [32] to detect muscle fatigue, and by and 10.1 mS/cm. Before tests, the insulator surfaces were
Ouyang et al [33] to identify hand grasp movement. washed with ethyl alcohol and rinsing with distilled water, in
Furthermore, Electroencephalograms (ECG) have been order to remove any trace of dirt.
analyzed using RQA to monitor the most common and chronic Tests are conducted under a fixed applied voltage equal to
neurological epilepsy disorder [34-35]. Moreover, RQA 12 kVrms. A Tektronix digital oscilloscope of bandwidth of
revealed successful early detection of seizure on ECG 500 MHz and PC are used to record the leakage current and
deducted from rats [36]. Whereas, Yang et al [37] announced applied voltage waveforms. Note that, leakage current signal
the ability of RQA to prevent Myocardial infarction (heart is measured trough a non-inductive resistance of 1 kΩ.
attack) when used to study Spatial Vectocardiogram (VCG) H.V.T.
500V/300kV, 50 Hz
signals.
C =400 µF
Since RQA revealed successful disease detection and R.T.
unhealthy pattern recognition in the medical domain, we 220/0 to 500 V
propose it in this paper to study and monitor polluted T.S.
insulators performance based on LC investigation. To achieve
this purpose, LC waveforms acquisition is firstly carried out
on a plan insulator model uniformly spread by a saline I.T. R = 1 kΩ
solution. Five conductivities of this solution have been chosen.
For each conductivity, Recurrent Plot (RP) is applied on LC
temporal waveform. RP diagrams show specific graphics and V.R.
morphologies for every pollution conductivity value. Hence,
RP monitors well enough the insulator performance during Oscilloscope
contamination conditions. RP seems to be an excellent tool to 500 MHz
flashover monitoring. However, it requires rigorous P.C.
interpretation and provides only a qualitative overview of the
insulator state. To overcome this deficiency, we propose the
H.V.T.: High Voltage Transformer, R.T.: Regulating Transformer
Recurrence Quantification Analysis (RQA). RQA is able not I.T.: Isolating Transformer, V.R.: Voltage Regulator
only to quantify appearing structures on RP diagram, but also P.C.: Personal computer, T.S.: Test Sample
to examine the variation and shifting of LC dynamic. Eight Figure 1. Laboratory test arrangement.

Authorized licensed use limited to: ULAKBIM UASL ISTANBUL TEKNIK UNIV. Downloaded on May 01,2021 at 18:51:23 UTC from IEEE Xplore. Restrictions apply.
3378 A. K. Chaou et al.: Recurrence Quantification Analysis as a Novel LC Feature Extraction Technique

3.2 RECURRENCE QUANTIFICATION ANALYSIS


(RQA)
The RQA is a method of non-linear data analysis for the
investigation of dynamical systems. This method, developed
Pulverization x25 by Webber and Zbilut [27], aims not only to quantify different
appearing structures in RP through indicators, but also to
50 cm study the shifting of a given signal’s dynamic. In this paper,
we focus on eight fundamental indicators [28]:
1. Recurrence Rate ( ) is the density of recurrence points in
a RP. corresponds to the probability that a specific
Figure 2. Pulverization method of the pollution on the insulator model. state will recur. is calculated by equation (2).
∑, , (2)
3 THEORETICAL BACKGROUND
2. Determinism ( ) is the ratio of recurrence points on the
In this section, we expose a concise theoretical background diagonal structures to all recurrence points. ,
of methods used in this paper. First, RP computation concept computed according to equation (3), is related with the
is explained. Then, typical RP structures and their
determinism of the system and points out the predictability
corresponding interpretations are detailed. Further, RQA
of the system. Diagonal lines represent epochs with similar
method is presented. In this work, we study eight RQA
time evolution of states. A high indicates that RP
indicators. Calculation and physical interpretation of these
indicators is exposed. Finally, a brief theory about three of the contains more and longer diagonal line structures
most known classification methods (K-Nearest Neighbors, compared with the stochastic process.

Naïve Bayes and Support Vector Machines) is given. These (3)
supervised classification methods are used to determine the ∑

pollution severity value. where is the frequency distribution of the lengths of the
diagonal structures in the RP. is the threshold, which
3.1 RECURRENT PLOT (RP) excludes the diagonal lines formed by the tangential motion of
Recurrent plots are graphical tools which visualize the a phase space trajectory.
recurrence behavior of the phase space trajectory of dynamical
3. Average diagonal line length ( ) represents the average
systems. RP was first proposed in 1981 by Maizel and Lenk
time where two segments of the trajectory are close to each
[40] as a method of visualizing patterns in sequences of
genetic nucleotides. It has since been introduced to study other, and can be interpreted as the mean prediction time.
dynamical systems. RP is computed as shown in equation (1). is given by equation (4).

, , 1, … , (1) ∑
(4)
,

where ||·|| is the norm (in this research, Euclidian norm is 4. Maximum of average diagonal line length ( ), which
adopted), (·) is the Heaviside function and is the studied represents the longest diagonal line found in the RP, is
time series. Equation (1) means that if the distance between calculated as in equation (5).
and is lessthan , then , = 1 and a dot is placed at , in max ; 1… (5)
the RP, else , = 0 and a blank is placed at , . where ∑ is the total number of diagonal lines.
To interpret RP diagrams, the use of Table 1 is more than 5. Laminarity ( ) is analogous to determinism except that
helpful. In fact, this table summarizes most common it is defined by the ratio of recurrence points forming
explanations about RP typologies and textures based on vertical structures to all recurrence points. indicates
studies carried out by Marwan et al [28]. the probability that a state will not change for the next time
step and is expressed according to equation (6).
Table 1. Interpretation of typical structures on RP diagrams.

RP Structures Interpretation ∑
(6)
Homogeneous Stationary process where is the distribution of the lengths of the vertical
Diagonal lines Periodicity structures.
Isolated points Strong fluctuations
6. Trapping time ( ) represents the average length of
Periodic/quasi- vertical structures. Its computation requires the
Cyclicities in the process
periodic patterns consideration of a minimal length . estimates the
Non-stationary data; presence mean time that the system will abide at a specific state or
White bands
of abrupt transitions how long the state will be trapped. is calculated as in
Vertical and Laminar states; Some states do equation (7).
horizontal line not change or change slowly ∑
Long bowed line Similarity in state evolution ∑
(7)

Authorized licensed use limited to: ULAKBIM UASL ISTANBUL TEKNIK UNIV. Downloaded on May 01,2021 at 18:51:23 UTC from IEEE Xplore. Restrictions apply.
IEEE Transactions on Dielectrics and Electrical Insulation Vol. 22, No. 6; December 2015 3379

7. Maximal length of the vertical lines ( ) is analogous to is to say, by transforming the LC from a high dimensional
the standard indicator ( is the absolute number of space to an -dimensional sub-space, RPs and RQA can be
vertical lines). can be regarded as the maximum time established to investigate more efficiently LC properties.
that the system will remain at a specific state and is 4.3 RQA INDICATORS
computed by equation (8).
Since RP describes time series visually (i.e. through
max (8)
graphical and morphological structures) but not quantitatively,
8. Entropy ( ) refers to the Shannon entropy of the the RQA quantifies a time series through the indicators based
probability / to find a diagonal line of on the RP. Therefore, by setting and equal to 2,
exactly length of l in the RP. , calculated by (9), RQA indicators shown in Figure 3c are computed, using
reflects the complexity of the RP concerning the diagonal equations (2) to (9). The higher the conductivity, the higher
lines. the LC waveforms amplitudes and the more pulses around the
∑ ln (9) maxima.
All the indicators show higher variations, bigger peaks and
3.3 CLASSIFICATION METHODS lower values when conductivity increases. , which
Three of the most commonly used classification techniques quantifies recurrent points, varies from 1 to 0.45 for a
are employed in this paper: the k-nearest neighbors’ classifier conductivity equal to 0.01 mS/cm, decreases until 0.81 for 1.2
(Knn), the Naïve Bayesian classifier and the Support Vector mS/cm and reaches almost 0 for 10.1 mS/cm. shows also
Machine (SVM). These three algorithms have already been tight peaks for 0.01 mS/cm, while larger ones are observed
used in many domains [40-44]. with the increase of the conductivity. High values of
indicate the presence of recurrent points on the RP, suggesting
4 RQA RESULTS the predictability of LC dynamic. However, small values of
In this section, we expose results of RP and RQA for LC indicate few recurrent points inferring white bands on the
waveforms investigation. For various pollution conductivities, RP. Thus, lower minimal values point out absence of
LC waveforms with their corresponding RP and RQA are recurrences, signifying the shifting of LC dynamic from
predictable to non-stationary one.
exposed. Results show that these indicators are highly
Similarly, values decrease when the pollution severity
correlated to the pollution severity level. Consequently, to
increases. , which points out the dynamic of a system, is
extract features from LC waveforms, we propose to compute
high for 0.01 mS/cm indicating that LC dynamic is
the mean values of these eight indicators. Finally, two
determinable and periodic. However, for a more severe
dimensional scatter plots indicate the ability of RQA mean
contamination, values diminish indicating that LC
values to distinguish between various levels of the pollution
waveforms move from a stochastic dynamic to non-periodical
severity.
one. This is due to the apparition of stronger discharges.
4.1 RP DIAGRAMS represents the average time that two segments of the
Using experimental arrangement described in chapter 2, the trajectory on the RP are close to each other. It can be
recorded LC waveform on 10000 points is presented in Figure interpreted as the mean prediction time. It shows larger
3a, RP diagrams are computed using equation (1) and exposed variations with the increase of pollution conductivity. Its
in Figure 3b. To interpret RP, we use Table 1. In case of 0.01 diminution indicates that LC is becoming less predictable.
mS/cm conductivity value, few points compose the RP Likewise, signal is composed of peaks. These peaks are
indicating weak discharge activity on the insulator model. For larger for 10.1 mS/cm suggesting the unpredictability of LC
1.2 mS/cm, formation of white bands is noticed which when the contamination is intensified.
designates the apparition of local arcing discharges on the is an important indicator. Although being analogous to
insulating surface. Finally, for 10.1 mS/cm, RP contains very , brings valuable information. It shows lower
dense points and larger white bands. The white segments point minimal values for the greater conductivity (10.1 mS/cm)
out the intermission of intensive discharges and the dense informing about the fewer occurrences of laminar states in the
points indicate the intensive arcing discharges. LC. Thus, there are more single recurrent points and larger
white segments to describe the RP. Such structure predicts
4.2 PHASE SPACE RECONSTRUCTION more random and unstable behavior of LC.
Before computing RQA, a phase space reconstruction, of High values of indicate the absence or slight change of
LC time series, has to be performed. This is a primordial LC in time; that is to say that LC is trapped for some time.
processing step, because it converts the LC signal into a This is a typical behavior of laminar states (intermittency).
recurrence plot in order to extract their features using RQA. Low values of suggest a fast incoming transition of the LC
Therefore, by using the Takens’ embedding theorem [45], LC to an unknown state predicting a forthcoming transition in LC
time series are transformed into phase space trajectories as dynamic. Also, , which is analogous of , varies in
described in (10). the same way.
Concerning (entropy), it is used for measuring the
, ,…, 1 . (10) complexity of a given signal. For 0.01 mS/cm, is close
where 0,1,2, … , , is the length of the time series, to 3, but shows peaks due to LC deformations. For 10.1
represents the embedding dimension, defines the delay mS/cm, presents lower minimal values and looks like a
between samples and is phase space trajectory sinusoidal signal. Such signal indicates the changing
describing the dynamical behavior of LC. According to [23], complexity of the LC waveform. Therefore, LC signal
and should be chosen equal to 5 and 20 respectively. That behavior is becoming non-periodical.

Authorized licensed use limited to: ULAKBIM UASL ISTANBUL TEKNIK UNIV. Downloaded on May 01,2021 at 18:51:23 UTC from IEEE Xplore. Restrictions apply.
3380 A. K. Chaou et al.: Recurrence Quantification Analysis as a Novel LC Feature Extraction Technique

0.01 mS/cm
0.01mS/cm 1,2
1.2 mS/cm
mS/cm 10,1 mS/cm
10.1mS/cm
1 6 20
LC (mA)

0 0 0

-1 -6 -20
0 2000 4000 6000 8000 10000 0 2000 4000 6000 8000 10000 0 2000 4000 6000 8000 10000
(a)
10000 10000 10000

9000 9000 9000

8000 8000 8000

7000 7000 7000

6000 6000 6000

5000 5000 5000

4000 4000 4000

3000 3000 3000

2000 2000 2000

1000 1000 1000

0 0 0
0 1000 2000 3000 4000 5000 6000 7000 8000 9000 10000 0 1000 2000 3000 4000 5000 6000 7000 8000 9000 10000 0 1000 2000 3000 4000 5000 6000 7000 8000 9000 10000

(b)

1 1 1
RR

0.9 0.8 0
0 2000 4000 6000 8000 10000 0 2000 4000 6000 8000 10000 0 2000 4000 6000 8000 10000
1 1 1
DET

0.9 0.9 0.7


13 13 15
10
L

5 5 0
20 20 20
Lmax

14 0 0
1 1 1
LAM

0.95 0.9 0.5


11 11 12
TT

8 5 0
20 20 20
Vmax

18

16 0 0
3 3 3
ENTR

2 1 0
0 2000 4000 6000 8000 10000 0 2000 4000 6000 8000 10000 0 2000 4000 6000 8000 10000
Sample Sample Sample
(c)
Figure 3. RQA for LC investigation under pollution, (a) LC waveforms for various conductivities, (b) RP representation, (c) RQA indicators waveforms.

Authorized licensed use limited to: ULAKBIM UASL ISTANBUL TEKNIK UNIV. Downloaded on May 01,2021 at 18:51:23 UTC from IEEE Xplore. Restrictions apply.
IEEE Transactions on Dielectrics and Electrical Insulation Vol. 22, No. 6; December 2015 3381

The higher the conductivity value, the lower the RQA dimensional space. To plot the eight indicators, 28
indicators minimal values. In fact, low values of these combinations are possible. Among them, we have randomly
indicators correspond to blank spaces on the RP and suggest a chosen the characteristics shown in Figure 4. It can be seen
non-periodical LC signal. Such RQA values result from from these scatter plots that the mean values of the eight
contamination which causes distortions and pulses on the LC indicators decrease with the increase of the pollution
waveforms, especially near peak regions. Therefore, RQA conductivity. Moreover, in every plot, we observe that RQA
values are composed of small magnitudes and tight peaks for mean values are gathered in five groups corresponding to the
pollution conductivities less than 1.2 mS/cm. However, for five pollution conductivity values. Such plots suggest that
10.1 mS/cm, RQA values contain big and large magnitude RQA means values are directly related to the pollution level.
peaks. Such variation quantifies and describes LC dynamic These indicators plots proof the ability of RQA to discern
under pollution. In other words, the deterioration of the between the pollution severity levels. Indeed, for a given
insulator performance is highlighted by the diminution of pollution conductivity, values of RQA indicators are situated
RQA indicators minimal values. These indicators announce in a specified interval. Consequently, RQA is chosen as a
the shifting of LC dynamic from periodical dynamic to non- feature extraction technique to determine and classify the
stationary one indicating the possible occurrence of the pollution severity based on LC examination. Hence, RQA
flashover. indicators mean values are chosen as inputs for classification
methods, while the output is the pollution conductivity value.
4.4 RQA FEATURE EXTRACTION
Flowchart of the algorithm using RQA for pollution
From Figure 3, RQA indicators are proven to be highly conductivity classification is exposed in Figure 5.
correlated to the pollution severity, thus to extract a feature
vector from RQA indicators, we opt for computing their mean
values. Indeed, to study the correlation between RQA 5 CLASSIFICATION RESULTS
indicators and the pollution level, we plot RQA indicators Three classification techniques used in this paper consist in
mean values two by two, for various pollution levels, on a two the k-nearest neighbors’ classifier (Knn), the Naïve Bayesian
1 20
0.01 mS/cm 0.01 mS/cm
0.9 0.19 mS/cm 0.19 mS/cm
0.71 mS/cm 18 0.71 mS/cm
1.2 mS/cm 1.2 mS/cm
0.8
10.1 mS/cm 10.1 mS/cm
16
0.7
Lmax
DET

0.6 14

0.5
12

0.4

10
0.3

0.2 8
0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1 2 3 4 5 6 7 8 9 10
RR L
(a) DET vs. RR (b) Lmax vs. L
1 17
0.01 mS/cm 0.01 mS/cm
0.19 mS/cm 16.5 0.19 mS/cm
0.9 0.71 mS/cm 0.71 mS/cm
1.2 mS/cm 16
1.2 mS/cm
10.1 mS/cm 10.1 mS/cm
15.5
0.8

15
ENTR
TT

0.7 14.5

14
0.6
13.5

13
0.5
12.5

0.4 12
0.4 0.5 0.6 0.7 0.8 0.9 1 8.5 9 9.5 10 10.5 11 11.5 12
LAM Vmax
(c) TT vs. LAM (d) ENTR vs. Vmax
Figure 4. RQA indicators mean values for various pollution severity levels.

Authorized licensed use limited to: ULAKBIM UASL ISTANBUL TEKNIK UNIV. Downloaded on May 01,2021 at 18:51:23 UTC from IEEE Xplore. Restrictions apply.
3382 A. K. Chaou et al.: Recurrence Quantification Analysis as a Novel LC Feature Extraction Technique

this work, “one vs. all” strategy and linear kernel function
Start were used.
To estimate the pollution severity through LC classification,
LC acquisition five labels are assigned to five pollution conductivities, from
the lightest to the heaviest ones (class 1 corresponds to 0.01
Phase space reconstruction mS/cm, while class 5 corresponds to 10.1 mS/cm), as
described in Table 2. Previously plotted in Figure 4, the LC
database is composed of 100 LC waveforms (20 per
RQA computation conductivity). 90 % of this database is used for training and
the rest for testing.
RQA feature extraction As shown in Table II, the obtained classification results are
successful for the 10 samples in the case of SVM and Knn
algorithms. However, Naïve Bayes classifier offers bad results
Naïve
with 4 misclassifications out of 10. These results are somehow
Knn SVM predictable. Having the ability to deal with linear and non-
Bayes
linear classification problems, SVM is known to be a high
performance classifier [43]. Knn seems also to be a very good
Pollution conductivity classification choice in this work. However, Naïve Bayes classifier,
although being simple and fast, shows low performance
especially when dealing with a limited database.
End
Figure 5. Flowchart of the proposed algorithm based on RQA feature The classification accuracy comparison of the three cited
extraction for LC pollution severity classification. methods highlights the importance of choosing the proper
classification technique. Indeed, to build an efficient
classifier and the Support Vector Machines (SVM). The k-
classification algorithm, both choices of the feature extraction
nearest neighbors (Knn) classifier [42] is simple and easy to
technique and the classification method are highly decisive.
implement. It requires no training and assigns an object to the
most common class among its k-nearest neighbors. Several
distances can be used to determine the nearest neighbors. The 6 CONCLUSION
Euclidian distance was chosen in this paper, with k equal to 1. In order to monitor the insulator performance and build a
The Naïve Bayes classifier [43] is a simple probabilistic proficient pollution severity diagnostic tool, an examination of
classifier based on Bayes theory. It implies the assumption LC signals though RQA was established. Showing an
that variables are statistically independent. It is known to be undoubted efficiency for signal dynamic analysis, eight RQA
rather effective. The Support Vector Machines (SVM) [44] is indicators of LC are computed and examined for various
considered as one of the most accurate machine learning pollution levels. These indicators characterized very well LC
classifiers because of its ability to solve problems of linear and signal behavior. Indeed, the higher the pollution conductivity
non-linear classification by finding the maximum margin value, the lower RQA indicators minimal values. Two
hyper plane that separates the classes. Several kernel functions dimensional scatter plots confirm that the eight indicators
can be used, including linear, polynomial, RBF, and sigmoid. mean values are highly linked to the pollution severity level.
However, SVM suffers from multi-class categorization Indeed, five groups are clearly noticeable corresponding to the
problem and has to be adapted in the case of multi-class five pollution levels. Thus, these eight indicators mean values
recognition problem (one vs. one or one vs. all strategies). In are chosen as input for three classification algorithms. Results

Table 2. Classification results.

Pollution Obtained class


Assigned
Sample conductivity Naïve
(mS/cm)
class Knn SVM
Bayes
1 0.877 0.899 9.410 17.55 1.740 0.743 9.407 16.428 10.1 5 5 5 5
2 0.749 0.942 3.799 11.28 0.631 0.665 9.281 17.128 10.1 5 5 5 5
3 0.89 0.989 9.974 18.40 2.221 0.897 10.73 18.634 1.2 4 4 4 4
4 0.875 0.995 9.937 17.38 3.933 0.898 9.676 16.412 1.2 4 4 3* 4
5 0.954 0.992 4.724 12.48 1.766 0.900 10.046 17.033 0.710 3 3 3 3
6 0.718 0.853 2.344 3.852 0.636 0.540 10.546 14.389 0.710 3 3 4* 3
7 0.954 0.992 5.219 12.98 2.061 0.900 10.341 17.228 0.190 2 2 2 2
8 0.718 0.853 2.839 4.347 0.931 0.541 11.249 14.578 0.190 2 2 3* 2
9 0.728 0.863 3.544 4.852 1.436 0.552 11.146 14.783 0.01 1 1 1 1
10 0.820 0.914 11.59 19.79 3.580 0.945 10.757 17.368 0.01 1 1 2* 1

Authorized licensed use limited to: ULAKBIM UASL ISTANBUL TEKNIK UNIV. Downloaded on May 01,2021 at 18:51:23 UTC from IEEE Xplore. Restrictions apply.
IEEE Transactions on Dielectrics and Electrical Insulation Vol. 22, No. 6; December 2015 3383

of classification announce SVM and Knn classifiers as the [17] A. Sidthik, L. Kalaivani and M. Iruthayarajan, “Evaluation and
prediction of contamination level in coastal region insulators based on
suitable algorithms to choose instead of the Naïve Bayes leakage current characteristics”, Int’l. Conf. Circuits, Power and
classifier and also RQA as an excellent LC feature extraction Computing Technologies (ICCPCT), pp. 132-137, 2013.
technique. Moreover, RQA allows to study LC dynamic [18] A.S. Ahmad, P. S. Ghosh and H. Ahmad, “Estimation of Salt
during the contamination process. In fact, LC dynamics is Contamination Level on the High Voltage Insulators Surfaces During
Rainy Season Using Artificial Neural Network”, Conf. Power System
noticed to be non-linear. For low pollution levels, LC is Management and Control, pp. 303-308, 2002.
sinusoidal. However, for the highest conductivity, LC [19] S. Jiao, D. Liu and Q. Zhang, “Assessment of surface contamination
waveform becomes distorted and contains peaks suggesting, condition of high voltage insulator based on fuzzy logic method”,
thus, a non-stationary dynamic. This paper presents an original Automation of Electric Power Systems, Vol. 7, pp. 84-87, 2005.
[20] X. Jiang X., Y. Shi, C. Sun and Z. Zhang, “Evaluating the safety
technique to monitor and study LC signal under contamination condition of porcelain insulators by the time and frequency
process. RQA is, not only, a novel method to study and characteristics of LC based on artificial pollution tests”, IEEE Trans.
investigate LC dynamics during the contamination process, Dielectr. Electr. Insul., Vol. 17, No. 2, pp. 481-489, 2010.
but also an efficient LC feature extraction technique to [21] J. P. Eckmann, S.O. Kamphorst and D. Ruelle, “Recurrence plots of
dynamical systems”, Europhysics Letters 4, Vol. 9, pp. 973-977, 1987.
determine the pollution severity level and monitor the [22] J. Belaire-Franch, D. Contreras, L. Tordera-Lledó, Assessing nonlinear
insulator performance. structures in real exchange rates using recurrence plot strategies, Physica
D: Nonlinear Phenomena, No. 171, Vol. 4, pp. 249-264. 2002
REFERENCES [23] A. Facchini, C. Mocenni, N. Marwan, A. Vicino and E. Tiezzi,
[1] A.M. Rahal and C. Huraux, “Flashover Mechanism of High Voltage “Nonlinear time series analysis of dissolved oxygen in the Orbetello
Insulators”, IEEE Trans. Power App. Syst., Vol. 98, No.6, pp. 2223- Lagoon”, Ecological Modeling, Vol. 3-4, pp. 339-348. 2007.
2231, December 1979. [24] B. X. Du, Y. Liu and H. J. Liu, “Recurrent plot analysis of leakage
[2] P. J. Lambeth, “Effect of pollution on high-voltage outdoor insulators”, current for monitoring outdoor insulator performance”, IEEE Trans.
Proc. IET, Vol. 118, No. 9, pp. 1107-1130, 1971. Dielectr. Electr. Insul, Vol. 16, No. 1, pp.139-146, 2009.
[3] R. Wilkins, “Flashover voltage of high-voltage insulators with uniform [25] Y. Liu and B. X. Du, “Recurrent plot analysis of leakage current on
surface-pollution films”, Proc. IEE, Vol. 116, No.3, pp. 457-465, 1969. flashover performance of rime-iced composite insulator”, IEEE Trans.
[4] S. Kumagai and N. Yoshimura, “Leakage Current Characterization for Dielectr. Electr. Insul Vol. 17, No. 2, pp. 465-472, 2010.
Estimating the Conditions of Ceramic and Polymeric Insulating [26] Y. Liu and B. X. Du, “Recurrent Plot Analysis of Leakage Current in
Surfaces”, IEEE Trans. Dielectr. Electr. Insul., Vol. 11, pp. 681-690, Dynamic Drop Test for Hydrophobicity Evaluation of Silicone Rubber
2004. Insulator”, IEEE Trans. Power Delivery, Vol. 28, No. 4, pp. 1996-2003,
[5] G. K. Amaldo and F. B. Geraldo, “Leakage Current Monitoring of 2013.
Insulators Exposed to Marine and Industrial Pollution”, IEEE Int’l. [27] Jr. Webber and C. L. Zbilut, “Recurrence quantification analysis of
Sympos. Electr. Insul. (ISEI), Montreal, Canada, pp. 271-274, 1996. nonlinear dynamical systems”, Tutorials in contemporary nonlinear
[6] I. Ramirez-Vazquez and J. L. Fierro-Chavez, “Criteria for the Diagnostic methods for the behavioral sciences, pp. 26-94. 2005.
of Polluted Ceramic Insulators Based on the Leakage Current [28] N. Marwan, M. C. Romano and M. Thiel, “Recurrence Plots for the
Monitoring Technique”, IEEE Conf. Electr. Insul. Dielectr. Phenomena Analysis of Complex Systems”, Physics Reports, Vol. 438, pp.237-329,
(CEIDP), Austin, Texas, USA, pp. 715-718, 1999. 2007.
[7] J. Li, C. Sun, W. Sima, Q. Yang, and J. Hu, “Contamination Level [29] J. P. Zbilut, Z. Hu, A. Giuliani and C. L. Webber, “Singularities of the
Prediction of Insulators Based on the Characteristics of Leakage Heart Beat as Demonstrated by Recurrence Quantification Analysis”,
Current”, IEEE Trans. Power Delivery, Vol. 25, No. 1, pp. 417-424, 22"d Annual Eng. Medicine Biology Soc. (EMBS) Int’l. Conf., Chicago
2010. IL, pp. 2406-2409, 2000.
[8] X. Jiang, Y. Shi, Z. Zhang and C. Sun, “Evaluating the Safety condition [30] M. Tang, C.Q. Chang, P.C.W. Fung, K.T. Chau and F.H.Y. Chan, “An
of Porcelain Insulators by the Time and Frequency Characteristics of LC Improved Method for Discriminating ECG Signals using Typical
Based on Artificial Pollution Tests”, IEEE Trans. Dielectr. Electr. Insul., Nonlinear Dynamic Parameters and Recurrence Quantification Analysis
17, Vol. 2, pp. 481-489, 2010. in Cardiac Disease Therapy”, IEEE, 27th Annual Conf. Eng. Medicine
[9] T. Suda, “Frequency Characteristics of Leakage Current Waveforms of and Biology, Shanghai, China, pp. 2459- 2462, 2005.
an Artificially Polluted Suspension Insulator”, IEEE Trans. Dielectr. [31] H. Ding, S. Crozier and S. Wilson, “A New Heart Rate Variability
Electr. Insul., Vol. 8, pp. 705-710, 2001. Analysis Method by Means of Quantifying the Variation of Nonlinear
[10] Y.C. Song and D.H. Choi, “High-frequency Components of Leakage Dynamic Patterns”, IEEE Trans. Biomedical Eng., Vol. 54, No. 9, pp.
Current as Diagnostic Tool to Study Ageing of Polymer Insulators under 1590- 1597, 2007.
Salt Fog”, Electronics Letters, No. 41, Vol. 12, pp. 684-685, 2005. [32] K. Ito and Y. Hotta, “EMG-based Detection of Muscle Fatigue during
[11] M. A. Douar, A. Mekhaldi and M. C. Bouzidi, “Flashover Process and Low-Level Isometric Contraction by Recurrence Quantification
Frequency Analysis of the Leakage Current on Insulator Model under Analysis and Monopolar Configuration”, IEEE 34th Annual Int’l. Conf.
non-Uniform Pollution Conditions”, IEEE Trans. Dielectr. Electr. Insul., Eng. Medicine Biology Soc. (EMBS), San Diego, California USA, pp.
Vol. 17, No. 4, pp. 1284-1297, August 2010. 509-512, 2012.
[12] D. Pylarinos, K. Theofilatos, K. Siderakis, E. Thalassinakis, I. Vitellas, [33] G. Ouyang, X. Zhu, Z. Ju and H. Liu, “Dynamical Characteristics of
A.T. Alexandridis and E. Pyrgioti, “Investigation and Classification of Surface EMG Signals of Hand Grasps via Recurrence Plot”, IEEE J.
Field Leakage Current Waveforms”, IEEE Trans. Dielectr. Electr. Insul., Biomedical and Health Informatics, Vol. 18, No. 1, pp. 257-265, 2014.
Vol. 19, No. 6, pp. 2111-2118, 2012. [34] A. F. Rabbi, M. K. Jaiswal, S. Lei and R. Fazel-Rezai, “Changes in
[13] J. Zhou, Q. Zhang, H. Xi and B. Gao, “An artificial neural network for Dynamical Characteristics of Epileptic EEG in Rats using Recurrence
pollution evaluation Based on Leakage Current”, Asia-Pacific Power Quantification Analysis”, IEEE 33rd Annual Int’l. Conf. Eng. Medicine
and Energy Eng. Conf. (APPEEC), pp. 1-4, 2012. Biology Soc. (EMBS), Boston, Massachusetts, USA, pp. 2562-2565,
[14] A. Jahromi, A. El-Hag, E. Chemey and S. Jayaram, “Prediction of 2011.
Leakage Current of Composite Insulators in Salt Fog Test Using Neural [35] N. Niknazar, S. R. Mousavi, B. V. Vahdat and M. Sayyah, “A New
Network”, IEEE Conf. Electr. Insul. Dielectr. Phenomena (CEIDP), pp. Framework Based on Recurrence Quantification Analysis for Epileptic
309-312, 2005. Seizure Detection”, IEEE Trans. Biomedical Eng., Vol. 17, No.3, pp.
[15] J.K. Basu, D. Bhattacharyya and T. Kim, “Use of Artificial Neural 572-578, 2013.
Network in Pattern Recognition”, Int’l. J. Software Engineering and Its [36] G. Ouyang, L. Xie, H. Chen, X. Li, X. Guan and H. Wu, “Automated
Applications, Vol. 44, No. 22, April 2010. Prediction of Epileptic Seizures in Rats with Recurrence Quantification
[16] C. M. Bishop, Neural Networks for Pattern Recognition, Clarendon Analysis”, IEEE, Eng. Medicine and Biology 27th Annual Conf.,
Press Oxford, ISBN 978-0198538646, 1995. Shanghai, China, pp. 153-156, 2005.

Authorized licensed use limited to: ULAKBIM UASL ISTANBUL TEKNIK UNIV. Downloaded on May 01,2021 at 18:51:23 UTC from IEEE Xplore. Restrictions apply.
3384 A. K. Chaou et al.: Recurrence Quantification Analysis as a Novel LC Feature Extraction Technique
[37] H. Yang, “Multiscale Recurrence Quantification Analysis of Spatial Ahmed Khaled Chaou received the degree of Engineer
Cardiac Vectorcardiogram Signals”, IEEE Trans. Biomedical Eng., Vol. and Masters degree in High Voltage Engineering from
58, No. 2, pp. 339-347, 2011. Ecole Nationale Polytechnique (ENP) of Algiers in 2012.
[38] P. I. Ternill, S. J. Wilson, S. Suresh, D.M. Cooper and C. Dakin, He is currently a Ph.D. degree student at the Electrical
“Attractor Structure Discriminates Sleep States: Recurrence Plot Engineering Department in the same School. His research
Analysis Applied to Infant Breathing Patterns”, IEEE Trans. Biomedical interests are in artificial intelligence, signal processing and
Eng., Vol. 57, No. 5, pp. 1108-1116, 2010. pattern recognition for polluted insulators diagnosis.
[39] S. I. Rathnayake, I. A. Wood, U. R. Abeyratne and C. Hukins,
“Nonlinear Features for Single-Channel Diagnosis of Sleep-Disordered Abdelouahab Mekhaldi was born in Algiers, Algeria in
Breathing Diseases”, IEEE Trans. Biomedical Eng., Vol. 57, No. 8, pp. 1958. He received the degree of Engineer in 1984 in
1973-1981, 2010. electrical engineering, a Masters degree in 1990 and a
[40] J. Maizel and R. Lenk, “Enhanced graphic matrix analysis of nucleic PhD in high voltage engineering in 1999 from Ecole
acid and protein sequences”, Proceedings of the National Academy of Nationale Polytechnique (ENP) of Algiers. He is currently
Sciences USA, Vol. 78, No. 12, pp. 7665-7669, 1981. a Professor at ENP of Algiers, His main research areas are
[41] X. Wu, V. Kumar, J. R. Quinlan, J. Ghosh, Q. Yang and H. Motoda, in discharge phenomena, outdoor insulators pollution,
“Top 10 algorithms in data mining”, Knowledge and Information polymeric cables insulation, lightning, artificial intelligence application in
Systems, Vol. 14, No. 1, pp. 1-37, 2008. high voltage insulation diagnosis and electric field calculation.
[42] T. M. Cover and P. E. Hart, “Nearest neighbor pattern classification”,
IEEE Trans. Inf. Theory, Vol. 13, No. 1, pp. 21-27, 1967. Madjid Teguar has obtained a first degree in electrical
[43] C. Bishop, Pattern Recognition and Machine Learning, Information engineering in 1990, a Masters degree in 1993 and a
Science and Statistics, Springer, ISBN 978-0-387-31073-2, 2006. Ph.D. degree in high voltage engineering in 2003 from
[44] V. N. Vapnik, The Nature of Statistical Learning Theory, Springer, Ecole Nationale Polytechnique (ENP) of Algiers. He is
ISBN0-387-94559-8, 2000. now a Professor in electrical engineering at ENP. His
[45] F. Takens, “Detecting strange attractors in turbulence”. Dynamical research interests are in insulation systems, insulation
Systems and Turbulence, Lecture Notes in Mathematics, Vol. 898. coordination, earthing of electrical energy systems and
Springer-Verlag. pp. 366-381, 1981. polymeric cables insulation

Authorized licensed use limited to: ULAKBIM UASL ISTANBUL TEKNIK UNIV. Downloaded on May 01,2021 at 18:51:23 UTC from IEEE Xplore. Restrictions apply.

You might also like