Professional Documents
Culture Documents
1 s2.0 S2405959521000096 Main
1 s2.0 S2405959521000096 Main
1 s2.0 S2405959521000096 Main
com
ScienceDirect
ICT Express 7 (2021) 15–22
www.elsevier.com/locate/icte
Abstract
Fault detection of rotating engine components in the aircraft engine is a challenging task that must constantly be monitored to provide
aviation safety. In this paper, we propose a novel approach based on multi-layer perceptron (MLP) to detect in real time the degree of faults
in a turbine engine disk due to a crack. To further improve detection accuracy while reducing computational complexity, the recursive feature
elimination (RFE) is applied as a potent feature selection method. Satisfactorily, simulation results show that the proposed framework is
robust to changes in operating conditions and outperforms comparative approaches.
⃝c 2021 The Korean Institute of Communications and Information Sciences (KICS). Publishing services by Elsevier B.V. This is an open access
article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
Keywords: Turbine engine disk; Fault detection; Multi-layer perceptron (MLP); Recursive feature elimination (RFE)
that are capable of working under severe environmental con- Although the aforementioned works demonstrated they out-
ditions. For instance, the authors in [15] and [16] proposed perform baseline schemes, the proposed methods did not iden-
sensor-based mechanisms by utilizing experimental measure- tify the severity level of the faults in a rotating turbine engine
ments obtained from the NASA Glenn Research Center’s disk, which can supply useful information to save mainte-
Rotor Dynamics Laboratory. Although a high-accuracy spin nance costs, plan precautionary measures, and enhance safety
system was used in [15] to collect the measurements, many monitoring through prompt reactions.
spins for the collected data were required to simulate different In the literature, artificial neural networks (ANN) have been
conditions that an engine faces with real-time applications. used in different scenarios for fault detection. For instance,
In [16], an inductive monitoring system (IMS), Orca, and a damage detection of arch bridges using ANN was studied
one-class support vector machine (OCSVM) algorithms were in [20] for security and efficiency purposes in the transport
studied to monitor a turbine engine-like rotor disk. The results network. The results showed that ANN can foretell rib dam-
showed that the algorithms can predict anomalies in the disk
ages and column damages with 99% and 97% of accuracy,
with the highest accuracy of 98.33% achieved by the Orca
respectively. In the context of crack or notch detection, in [21],
algorithm.
MLP was applied to detect a notch type damage in a thin
Machine learning methods are data-driven when making
predictions. However, some datasets have useless information aluminum plate. As a result, the MLP classifier correctly
that reduces the accuracy of the learning model. To tackle categorized the data into healthy and damaged groups with an
this issue, methods for feature selection or dimensionality accuracy of 85%. In our previous work [9], an MLP-based
reduction have been studied. For instance, in our previous scheme with binary particle swarm optimization (B-PSO) was
work [9], a binary particle swarm optimization (B-PSO) al- proposed where B-PSO was applied as a feature selection
gorithm was applied as a feature selection method to choose method to choose useful features. The results showed that
useful features, instead of those that are redundant or useless the MLP assisted by B-PSO achieved the highest accuracy
and that do not provide helpful information to detect faults for binary fault detection prediction (i.e., normal or cracked)
in turbine engine disks. The simulation results showed that in comparison with benchmark schemes. Different from the
the proposed multi-layer perceptron (MLP)-based scheme with previous work, we consider a multi-class classification scheme
B-PSO achieved the highest accuracy for binary fault detection based on MLP to categorize the level of the crack which
prediction (i.e., normal or cracked) in comparison with bench- allows us to predict the failure at an early stage. Moreover, to
mark schemes. In [12], a multiclass support vector machine further improve the performance of the prediction, RFE-based
(MCSVM) was used to train the data with the best features feature selection method is utilized to choose useful features,
selected by the feature selection method named recursive instead of those which are redundant or useless and that do
feature elimination (RFE). The results showed that the MCSM- not provide helpful information to detect faults in turbine
RFE framework achieves an accuracy that exceeds 95%. Chen engine disks. To this end, RFE is one of effective approach
et al. proposed a combination of a kernel principal component to feature selection which has been frequently applied in the
analysis (KPCA) method and K-nearest neighbors (KNN) to engineering field for fault detection purposes [9,22,23] by
reduce the quantity of redundant samples [17]. Subsequently, ridding the least important features even for small-sample
this sample-reduction strategy can enhance the accuracy of
feature selection [24].
real-time fault detection in turbine engine disks. Furthermore,
Our main contributions are summarized as follows.
the authors minimized the within-cluster distance and maxi-
mized the between-cluster distance in the feature space to fit • A multi-class fault detection scheme for turbine engine
the model along with time, and to deal with different events disks is investigated in this paper by applying the MLP-
that a turbine engine disk could face. The results showed that based scheme to categorize a sample as normal or as
the sample-reduction technique enhanced accuracy for fault having a small crack or a large crack. Note that small
detection in turbine engine disks. Similarly, in [18], the authors cracks and large cracks constitute fault samples that
proposed an adaptive Gaussian mixture model (GMM)-based
allow us to determine the severity of the failure.
fault detection method for rotating turbine engine disks, which
• In order to enhance the performance of our framework,
can be updated to time-varying process data. Experimental
we propose RFE as a feature selection method, which
results demonstrated that the GMM method outperformed the
classic GMM and multi-PCA baseline schemes. In [1], a sup- removes redundant and irrelevant features involved in
port vector machine with a KNN-based method was applied the dataset that do not provide useful information. This
to fault detection of turbine engine disks. Experimental results technique reduces computational complexity while im-
demonstrated the importance of a model that allows timely proving prediction performance.
updates according to the state of the rotating turbine engine • We verify through simulation results that the proposed
disk, since the yield of the conventional static model was MLP classifier with the RFE feature selection method
improved by applying an adaptive learning strategy. On the outperforms other benchmark approaches like B-PSO
other hand, a fault detection scheme was proposed in [19] and principal component analysis (PCA). Also, we com-
based on one-class large vector-angular region and margin pared our propose MLP classifier algorithm with the
(one-class LARM), which provides a high accuracy rate with powerful random forest (RF), obtaining satisfactory re-
few samples. sults.
16
C.E. Garcia, M.R. Camana and I. Koo ICT Express 7 (2021) 15–22
Table 1
Recordings of the dataset [16].
Normal Small crack Large crack
3krpm-3-min-no-notch.xls 3krpm-3min-notch-1.xls 3krpm-3-min-large-notch.xls
4krpm-3min-no-notch.xls 4krpm-3min-notch-1.xls 4krpm-3-min-large-notch.xls
5krpm-3min-no-notch.xls 5krpm-3min-notch-1.xls 5krpm-3-min-large-notch.xls
Table 2
Parameter descriptions [16].
Parameter name Description Units
Rev# Revolution measurement integer
SyncTime Clock time s
RPM Measured RPM rpm
MaxGap Maximum gap across all gap sensors length
AvgGap Average gap across all gap sensors length
MinGap Minimum gap across all gap sensors length
Gap0 Measured gap for blade 0 length
... ... ...
Gap31 Measured gap for blade 31 length
layer has the bias vector denoted as b(1) and the ReLU activa- consisted of 900 and 6000 samples, respectively, in which
tion function denoted as g. The weight matrix, W(1) , connects samples for 3000, 4000, and 5000 rpm were considered for
the input vector to the hidden layer. all three classes. Fig. 5 shows the distribution of the datasets
considered in this paper. It is noteworthy that the samples
4. Simulation results at 5000 rpm are not used during the training phase and we
In this section, we present the simulation results from using use this data to analyze the robustness of the model against
the turbine engine disk dataset [25]. To perform the analysis, changes in the operational conditions.
we selected features based on revolutions per minute and the Furthermore, we present an example of the classification
measured gaps for blade 0 to blade 31, which is a total of 33 problem in Figs. 6 and 7, where the values of two features
features for three different classes (normal, small crack, large and 3000 samples are considered to represent the class of each
crack). The simulations were carried out on a computer with sample for the 3000 rpm and 5000 rpm scenarios, respectively.
16 GB of RAM and an Intel Core i7-6700K CPU and by using We can see that 5000 rpm is the most challenging scenario,
the scikit-learn library in the Anaconda environment. since the distribution of the data does not allow a linear
From the dataset, we considered three different parts ac- classifier. Therefore, we selected MLP, which is suitable for
cording to the way in which the data are used: training, data that are not linearly separable. Moreover, the selection of
validation, and testing. The training data are used to select the the best features is a crucial factor to achieve high performance
best features through the RFE algorithm and to build the MLP
from the predictions.
model. The validation data are used to select the best model
In this paper, we consider three metrics to analyze the
and to tune the hyper-parameters of the model, for instance
learning rate, batch size, number of hidden neurons, and so on. numerical results: accuracy, precision, and recall. Accuracy is
The testing data are used to evaluate the final accuracy of the the ratio of correctly predicted samples to total samples and
trained model, and comprise data unseen during the training evaluated over the testing data. The confusion matrix is defined
process of the model. In the simulations, we used a training in Table 3, which allows us to visualize the performance of the
dataset composed of 500 samples, where we only considered proposed scheme. Each row of the matrix represents the true
samples for 3000 rpm and 4000 rpm for the three classes, class, while each column represents a predicted class.
19
C.E. Garcia, M.R. Camana and I. Koo ICT Express 7 (2021) 15–22
Table 3
Confusion matrix.
Predicted class
Normal Small crack Large crack
Normal C11 C12 C13
True class Small crack C21 C22 C23
Large crack C31 C32 C33
Table 4
Feature selection analysis.
No. of features Accuracy (%) Precision (%) Recall (%)
2 99.830 99.831 99.830
3 99.799 99.800 99.789
4 99.998 99.998 99.998 Fig. 8. Batch size selection.
5 99.996 99.996 99.996
6 99.989 99.989 99.989
10 97.466 97.573 97.466
Table 5
Performance comparison for the fault classification problem.
Algorithm Accuracy (%) Precision (%) Recall (%)
RFE + MLP (proposed) 99.982 99.982 99.982
MLP 98.445 98.515 98.445
PCA + MLP 98.714 98.738 98.714
BPSO + MLP 92.795 94.005 92.795
PCA-RF 82.353 87.082 82.353
RF 95.310 95.888 95.310
Table 6
Precision and recall scores for the fault classification problem.
Alg. Prec. N Prec. SC Prec. LC Rec. N Rec. SC Rec. LC
RFE + MLP (prop) 100 99.95 100 100 100 99.95
MLP 100 95.54 100 98.19 100 97.14
PCA + MLP 97.02 99.20 100 100 96.92 99.22
BPSO + MLP 99.55 82.46 100 98.19 99.56 80.63
PCA-RF 96.90 66.26 98.08 64.75 96.63 85.68
RF 100 87.66 100 85.95 100 99.98
21
C.E. Garcia, M.R. Camana and I. Koo ICT Express 7 (2021) 15–22
Table 7 [8] I. Guyon, J. Weston, S. Barnhill, V. Vapnik, Gene selection for cancer
Normalized confusion matrix for the proposed scheme. classification using support vector machines, Mach. Learn. 46 (2002)
Predicted class 389–422.
[9] C.E. Garcia, M.R. Camana, I. Koo, Real-time fault detection for
Normal Small crack Large crack
turbine engine disk, in: International Conference on ICT Convergence
Normal 1 0 0 (ICTC), Jeju, South Korea, 2020, pp. 1–6.
True class Small crack 0 1 0 [10] Y. Freund, R.E. Schapire, Large margin classification using the
Large crack 0 0.00054 0.99947 perceptron algorithm, Mach. Learn. 37 (3) (1999) 277–296.
[11] L.-Y. Chuang, S.-W. Tsai, C.-H. Yang, Improved binary particle swarm
optimization using catfish effect for feature selection, Expert Syst.
Appl. 38 (10) (2011) 12699–12707.
and convergence of the proposed algorithm. Simulations re- [12] S. Mustapha, A. Braytee, L. Ye, Multisource data fusion for classi-
sults prove the robustness of the model since high accuracy fication of surface cracks in steel pipes, J. Nondestruct. Eval. Diagn.
is achieved in the testing data, which contains samples of Progn. Eng. Syst. 1 (2) (2018).
5000 rpm that were not used in the training phase. Finally, [13] C.E.G. Moreta, M.R.C. Acosta, I. Koo, Prediction of digital terrestrial
the proposed scheme was able to detect all the faults in the television coverage using machine learning regression, IEEE Trans.
testing dataset since there were no small-crack and large-crack Broadcast. 65 (4) (2019) 702–712.
[14] M. Woike, A.A. Aziz, N. Oza, B. Matthews, New sensors and
samples misclassified as normal. techniques for the structural health monitoring of propulsion systems,
Sci. World J. 2013 (2013) 1–10.
CRediT authorship contribution statement [15] A. Abdul-Aziz, M. Woike, G. Baaklini, J.R. Bodis, Turbine engine
disk rotor health monitoring assessment using spin tests data, in:
Carla E. Garcia: Conceptualization, Methodology, Soft- Procedings of Smart Sensor Phenomena, Technology, Networks, and
ware, Validation, Formal analysis, Investigation, Data curation, Systems Integration, San Diego, California, United States, 2012,
Writing - original draft, Writing - review & editing. Mario R. pp. 248–258.
Camana: Visualization, Data curation, Validation. Insoo Koo: [16] A.A. Aziz, M. Woike, N. Oza, B. Matthews, G. Baakilini, Propulsion
Resources, Writing - review & editing, Supervision, Project health monitoring of a turbine engine disk using spin test data, in:
Procedings Health Monitoring of Structural and Biological Systems,
administration, Funding acquisition.
San Diego, California, United States, 2010, pp. 431–440.
[17] J. Chen, X. Zhang, Y. Gao, Fault detection for turbine engine disk
Declaration of competing interest based on an adaptive kernel principal component analysis algorithm,
Proc IMechE, I: J. Syst. Control Eng. 230 (7) (2016) 651–660.
The authors declare that they have no known competing [18] J. Chen, X. Zhang, N. Zhang, K. Guo, Fault detection for turbine
financial interests or personal relationships that could have engine disk using adaptive Gaussian mixture model, Proc. Inst. Mech.
appeared to influence the work reported in this paper. Eng. I 231 (10) (2017) 827–835.
[19] J. Chen, Y. Wei, H. Wang, X. Zhang, Fault detection for turbine engine
Acknowledgments disk based on one-class large vector-angular region and margin, Math.
Probl. Eng. 2020 (2020) 1–11.
This work was supported in part by the National Re- [20] W.K.N. Jayasundara, Damage Detection of Arch Bridges using Vi-
search Foundation of Korea through the Korean Government bration Characteristics and Artificial Neural Network, Queensland
Ministry of Science and ICT (MSIT) under Grant NRF- University of Technology, 2020.
[21] Sabith Yoonus Nalakath1, Kashif Saeed2, Khalid A. Alnefaie3, Detec-
2018R1A2B6001714.
tion of a notch type damage using subspace identification and artificial
neural networks, Int. J. Emerg. Technol. Adv. Eng. 4 (8) (2014).
References [22] S.S. Roy, S. Dey, S. Chatterjee, Autocorrelation aided random forest
classifier-based bearing fault detection framework, IEEE Sens. J. 20
[1] J. Chen, X. Xu, X. Zhang, Fault detection for turbine engine disk
based on adaptive weighted one-class support vector machine, J. Electr. (18) (2020) 10792–10800.
Comput. Eng. 2020 (2020) 1–10. [23] I. Bandyopadhyay, P. Purkait, C. Koley, Performance of a classifier
[2] U. Dinesh Kumar, J. Crocker, J. Knezevic, Evolutionary maintenance based on time-domain features for incipient fault detection in inverter
for aircraft engines, in: Annual Reliability and Maintainability, in: drives, IEEE Trans. Ind. Inf. 15 (1) (2019) 3–14.
1999 Proceedings (Cat. No.99CH36283), Symposium, 1999. [24] X. Chen, J.C. Jeong, Enhanced recursive feature elimination, in:
[3] A. Abdul-Aziz, M.R. Woike, N.C. Oza, B.L. Matthews, J.D. lekki, Sixth International Conference on Machine Learning and Applications
Rotor health monitoring combining spin tests and data-driven anomaly (ICMLA 2007), 2007.
detection methods, Struct. Health Monit. 11 (1) (2011) 3–12. [25] Rotary dynamics laboratory at NASA Glenn research center, Disk
[4] M.S. Hameed, I.A. Manarvi, Using FEM and CFD to locate cracks defect data, Available in: https://c3.nasa.gov/dashlink/resources/314/.
in compressor blades for non destructive inspections, in: 2009 IEEE [26] P.M. Granitto, C. Furlanello, F. Biasioli, F. Gasperi, Recursive feature
Aerospace Conference, 2009. elimination with random forest for PTR-MS analysis of agroindustrial
[5] M. Genest, G. Li, Inspection of aircraft engine components using products, Chemometr. Intell. Lab. Syst. 83 (2) (2006) 83–90.
induction thermography, in: 2018 IEEE Canadian Conference on [27] B.F. Darst, K.C. Malecki, C.D. Engelman, Using recursive feature
Electrical & Computer Engineering (CCECE), 2018. elimination in random forest to account for correlated variables in
[6] Z. Zhao, F. Morstatter, S. Sharma, S. Alelyani, A. Anand, H. Liu, high dimensional data, BMC Genet. 19 (1) (2018) 65–70.
Advancing feature selection research, in: ASU Feature Selection [28] C.M. Bishop, Pattern Recognition and Machine Learning, Springer,
Repository, 2010, pp. 1–28. Cambridge, 2006.
[7] P. Langley, Selection of relevant features in machine learning, in: [29] A. Tharwat, Principal component analysis - a tutorial, Int. J. Appl.
Proceedings of the AAAI Fall Symposium on Relevance, 1994, Pattern Recognit. 3 (3) (2016) 197–240.
pp. 140–144.
22