Professional Documents
Culture Documents
1 s2.0 S014111871730768X Main
1 s2.0 S014111871730768X Main
Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea
Keywords: The energy efficiency of ocean-going vessels can be increased through various operational considerations, such
Ship powering performance as improved cargo arrangements and weather routing. The first step toward the goal of maximizing the energy
Gaussian processes efficiency is to analyze how the ship's powering performance changes under different operational settings and
Domain knowledge weather conditions. However, existing analytical models and empirical methods have limitations in reliably
Environmental uncertainty
estimating the powering performance of full-scale ships in real operating conditions. In this study, machine
learning techniques are employed to estimate the powering performance of a full-scale ship by constructing
regression models using the ship's operational data. In order to minimize the risk of overfitting in the regression
process, domain knowledge based on physical principles is combined into the regression models. Also, the
uncertainty of the estimated performance is evaluated with consideration of the environmental uncertainties.
The obtained regression models can be used to predict the ship speed and engine power under different op-
erational settings and weather conditions.
1. Introduction and associated emissions of a ship were assessed using the ship's op-
erational data [8–10]. Also, the fuel consumption and speed curve of a
International regulations on the energy efficiency of ocean-going ship were estimated using noon reports [11], a decision support system
vessels have been reinforced in response to increased concerns about for predicting the fuel consumption was suggested [12], and the ship's
environmental pollution and global warming. This drives the research energy efficiency was estimated using Monte-Carlo methods [13].
to analyze the powering performance of full-scale ships under varying More recently, machine learning (ML) techniques have been
environmental and operating conditions [1,2]. There are various factors adopted and utilized to estimate the powering performance of ships.
that affect the powering performance and the resulting fuel efficiency of Artificial neural network (ANN) and Gaussian process (GP) techniques
ships, such as operational settings, weather conditions and human were employed to calculate the ship's fuel efficiency [14–16] and an
factors. Fig. 1 illustrates how the ship speed and engine power are in- ensemble neural network was used to predict the shaft power of a
fluenced by these operational settings and environmental conditions. towboat [17]. The k-nearest neighbor (k-NN) algorithms was applied to
Various analytical methods and empirical formulas have been sug- trim optimization [18], and the support vector machine (SVM) was
gested in the past [3], however they do not provide satisfactory results used to identify parameters of a ship [19–21].
in modeling the ship's powering performance in real-sea operating However, the performance models that are purely based on the above-
conditions with sufficient accuracy, mainly because of the lack of op- mentioned machine learning algorithms are often susceptible to statistical
erational data, measurement uncertainties and the complex relation- overfitting [22]. There are many influencing factors associated with ship
ships between the ship performance and various influencing factors [4]. performance modeling, and increasing the number of parameters in the
As computational resources have become more powerful and effi- model generally reduces the regression error. In order to minimize the
cient, data-driven statistical methods for analyzing the powering per- risk of overfitting, this study suggests incorporating the domain knowl-
formance of full-scale ships using measurement data obtained in real edge of ship propulsion into the design of regression models based on
operating conditions have attracted increased attention. A gray-box statistical analysis and machine learning. As a machine learning method,
model was used to determine the optimal operating conditions and GP is proposed to be used, which is known to be effective and powerful in
predict the fuel consumption of a ship [5–7], and the fuel consumption describing complicated nonlinear models [23–25].
⁎
Corresponding author at: Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology (KAIST), 291 Daehak-ro, Yuseong-gu,
Daejeon 34141, Republic of Korea.
E-mail address: jinwhan@kaist.ac.kr (J. Kim).
https://doi.org/10.1016/j.apor.2018.10.013
Received 1 January 2018; Received in revised form 8 October 2018; Accepted 19 October 2018
Available online 02 November 2018
0141-1187/ © 2018 Elsevier Ltd. All rights reserved.
B. Yoo, J. Kim Applied Ocean Research 82 (2019) 1–9
Table 2
List of measurement data.
Ship operational data Weather forecast data
2.1. Data for performance analysis Fig. 2. Scatter plot of engine power vs. ship speed.
2
B. Yoo, J. Kim Applied Ocean Research 82 (2019) 1–9
Fig. 4. Graphical model with the conditional independence between the ship
Fig. 5. Graphical model representing the dynamics of ship propulsion: The
speed and engine power given the input variables, expressed by Eq. (1).
relevant equation numbers are shown next to corresponding nodes.
since the ship speed and engine power are in fact dependent. Using these equations, a full graphical model is established as
In this study, a new probability model that considers a more realistic shown in Fig 5 , which can be considered as a dynamic Bayesian net-
relationship between the influencing factors is proposed. For this, gra- work (DBN) [30].
phical models are constructed based on the physical principles asso- Fig. 5 represents the time-dependent ship performance, and the
ciated with ship propulsion, and the relationship between the related superscripts t − 1, t, and t + 1 indicate the previous, current, and next
physical variables are analyzed qualitatively. time step, respectively. At time t, the thrust Tt and the total resistance of
Under quasi-static conditions, the dynamics of ship propulsion [26] the ship Rt determine the acceleration of the ship at and consequently
can be described using the equations in the following: the speed Vt. QBt and Qpt , which are determined by nt, are also influenced
by PBt and Vt, respectively. The engine and propeller torques affect the
Engine RPS: nB = np (2)
engine RPS at the next time step nt+1, and this process is repeated in
Engine power: PB = 2 nB QB (3) time.
The graphical model in Fig. 5 can be simplified as the model illu-
Propeller thrust: T = KT np2 d4 (4) strated in Fig. 6 which is represented in terms of the key variables
specified in Eq. (1). Considering that the main interest of this study is to
Propeller torque: Qp = KQ np2 d5 (5) model the ship's powering performance in steady-state, Fig. 6 can be
further simplified into the model shown in Fig. 7. In the steady-state
Engine dynamics: 2 Ip np = s QB Qp (6) operating condition, the value of the state variables (i.e., node values)
do not change in time, and thus the edges connecting the current states
Ship dynamics: T = R (7)
and the same states at the previous time step are removed.
Ship resistance: R = fr (V , O, W ). (8) From the d-separation property [31], the engine power is con-
ditionally independent of the operating and weather conditions, given
the engine RPS and ship speed. According to the steady-state graphical
model shown in Fig. 7, the target probability model can be represented
as follows:
nB Engine RPS (RPM/60) np Propeller RPS (RPM/60)
QB Engine torque Qp Propeller torque
KQ Torque coefficient KT Thrust coefficient
p (PBt, V t|nBt , nBt+ 1, Ot , W t ) p (PB, V |nB , O, W )
T Thrust R Ship resistance = p (PB |V , n, O , W ) p (V |n, O, W )
d Propeller diameter ρ Density of water = p (PB |V , n) p (V |n, O , W ). (9)
Ip Total inertia of propeller
ηs Mechanical efficiency from engine to propeller
λ Gear ratio between propeller shaft and engine
Note that the superscripts indicating time step have been dropped out,
since the target probability model is expressed in the steady-state
condition.
The engine power can be calculated using the propeller RPS and In the obtained steady-state graphical model, the engine power is
torque. The propeller thrust and torque are characterized by the thrust modeled as p(PB|V, n) with the ship speed and engine RPS as input
and torque coefficients, KT and KQ, as shown in Eqs. (3) and (4). In
general, these two coefficients are experimentally determined by the
model test, and modeled as the polynomial function of the ship's ad-
vance ratio [27].
In Eq. (8), the ship resistance is expressed as a nonlinear function fr
which depends mainly on the ship speed and also affected by the op-
erational settings and weather conditions. Various studies have been
conducted to establish a ship resistance model considering the non-
linear hydrodynamic effects [28], however it is still difficult to reliably
estimate the resistance in different operational settings and weather
conditions, especially due to complex ship motions in waves.
For ships with diesel engines, the main engine is generally directly
connected to the propeller shaft [29]. Therefore, the engine RPS nB is
regarded to be the same as the propeller RPS np, both represented by n, Fig. 6. Graphical model for the simplified dynamics of ship propulsion in terms
hereafter. of PB, V, n, O and W.
3
B. Yoo, J. Kim Applied Ocean Research 82 (2019) 1–9
ship speed are not as direct as the effect of wind and wave in the
longitudinal direction. However, it is worthwhile to note that the cross-
wind and cross-wave components show high correlation with the
rudder angle. This is conjectured to be due to the fact that the en-
vironmental disturbances in the ship's lateral direction induce the use of
the ship's rudder to counteract the sideway forces. In order to more
closely examine the relationship between each individual environ-
mental disturbance and the rudder angle, two scatter plots are shown in
Fig. 9.
The figure shows that the rudder angle is highly correlated with the
cross-wave and cross-wind disturbances, which agrees with the result of
PCA and the following conjecture. Considering this finding, instead of
the cross-wave and cross-wind, the rudder angle is introduced into the
Fig. 7. Graphical model for the ship propulsion in steady-state operating con- model as an additional independent variable. Therefore, the engine
ditions. RPS, trim, draft, head-wave, head-wind, and rudder angle are selected
as the independent variables to estimate the probability model for the
ship speed.
variables. This probability model involves less input variables com- Using the rudder angle as an independent variable can be ad-
pared to the model in Eq. (1). In particular, the weather and operating vantageous in modeling the ship's powering performance. However, it
conditions are not directly involved in this probability model, which may not be straightforward to predict the powering performance given
reduces the required number of regression parameters and decreases the weather forecast information only. To estimate the expected rudder
the risk of overfitting. usage under the environmental disturbances in the lateral direction for
The probability model for ship speed, p(V|n, O, W), involves more applying the proposed approach to the performance prediction, the
candidate input variables, including the engine RPS, operating and rudder angle is modeled as a linear function of the cross-wave and
weather conditions. It is desirable to reduce the number of independent cross-wind conditions based on the ship operational data. This function
variables to minimize the risk of overfitting. Among various weather- can be utilized when the ship powering performance needs to be pre-
induced environmental disturbances, wave and wind are dominant in- dicted solely using weather forecast data.
fluencing factors that affect the ship resistance and speed. In this study,
for a convenient and accurate evaluation of weather-induced dis- 3. Regression models
turbance effects on the ship's propulsion performance, the wind speed
and wave height are represented separately in their longitudinal (head- In this study, the probability model of the ship's powering perfor-
wind and head-wave) and lateral (cross-wind and cross-wave) compo- mance is expressed as the multiplication of two probability functions:
nents relative to the ship's heading direction. Using these coordinate- the probability function for the ship's speed and the probability function
transformed environmental disturbances, the principal component for the engine power. The probability function for the speed p(V|n, O,
analysis (PCA) is applied to investigate the influence of these environ- W) involves the environmental disturbance components which are
mental disturbances on the powering performance, the resulting plot is difficult to be modeled using conventional parametric approaches.
shown in Fig. 8. Considering this difficulty, the GP model is proposed to be used to
Fig. 8 shows that the vectors associated with the variables of interest build the regression model for the ship speed. GP is a powerful tool for
are projected onto the first two principal axes. If the arrows of different statistical regression in a continuous space [32]. It assumes that the
variables are collinear, it indicates that the corresponding variables are model function f(x) follows a Gaussian process and can be modeled
highly correlated. The result shows that the head-wave and head-wind using input and output data. The conditional distribution of the test
components in the ship's longitudinal direction have a high correlation outputs f* given the measurements is important for GP regression,
with the ship speed. The effects of cross-wave and cross-wind on the which is described as
2
f*|X* , X , f N (µf (X*), f (X *)) (10)
where
µf (X*) = K (X* , X ) K (X , X ) 1f
2
f (X *) = K (X * , X * ) K (X* , X ) K (X , X ) 1K (X , X*).
2 d (xi xi )2
k (x , x ) = f0 exp i=1 2 2
fi (11)
where i = 0, …, d are the hyper-parameters of the regression model.
2
fi ,
More details regarding the GP algorithm can be found in [32].
4
B. Yoo, J. Kim Applied Ocean Research 82 (2019) 1–9
Fig. 9. Scatter plots show the correlation between the rudder angle and the environmental disturbances in the lateral direction.
where
3.1.2. Engine power
The equation of dynamics for the engine power can be expressed as: 2 1 (1 wf ) 2 2
C1 = , C2 =
2 sd s
PB = 2 QB n = (KQ d5n2 ) n.
s (14)
Here, the torque coefficient KQ is modeled as a function of the advance 3.2. Uncertainty modeling
ratio J = V (1 wf )/(nd) where wf is the wake fraction factor. In gen-
eral, model tests are conducted to find KQ and wf , and thus these Among the selected independent variables for modeling the ship
parameters are not directly available in full-scale ship operational data. powering performance, weather data have relatively large uncertainty,
In order to determine the torque coefficient only using the ship op- and thus their uncertainty effects are incorporated into the regression
erational data, the scatter plot in Fig. 2 is examined and analyzed more models. The weather data are provided by weather forecast services and
closely, as shown in Fig. 10. they are given with no uncertainty information. Therefore, in this
5
B. Yoo, J. Kim Applied Ocean Research 82 (2019) 1–9
study, environmental uncertainties are modeled using the general sta- random variables, and their means and variances are determined by
tistical distributions around the given weather conditions. In the ex- linear regression [39–42] using the ship's operational data.
isting literature, Rayleigh distributions are commonly used to model the
statistical distributions of wind speed and wave height [34–36]. Here, 4. Results and discussion
the variance parameters of the Rayleigh distributions for wave height
and wind speed are estimated using the significant wave height and the The given full-scale operational data were split into training and test
average wind speed given in the weather data. Then, the estimated datasets. The ratio between the training and test datasets was set to 2:1
weather uncertainty distributions are approximated as Gaussian dis- and the test dataset was not used during the training step for estimating
tributions for using them as input uncertainties into the GP regression the regression model.
model. The performance of regression for the ship speed and the engine
power is evaluated by the root-mean-square error (RMSE) and the
3.2.1. Ship speed normalized root-mean-square error (NRMSE)
By approximating the uncertainty inputs as Gaussian distribution
yi )2
[37,38], the GP-based probability model for the ship speed is estimated.
N
i = 1 (yˆi
RMSE =
Given a set of N data pairs = {y i , x i }iN= 1, f(x) indicates the GP function N
RMSE
for the ship speed. The distribution of the function of random variable NRMSE = y¯ (20)
x * N (µ x , x ) is obtained by
where y is the measured data of the output variable, ŷ is the estimated
*
*
p (f (x *)|µ x , x*, )= p (f (x *)|x *, ) p (x *)dx*. (16) output, N is the number of the data points, and ȳ is the mean value of
*
the measured data y, which is a normalizing factor.
The integral in Eq. (16) is analytically intractable due to the complexity
of p(f(x*)|x*), and thus it is approximated as a Gaussian distribution.
The mean and variance of this approximated function are expressed as: 4.1. Regression model for ship performance
2 2 1
2 2 (x )
f * Vˆ = a1 n2 + a2 Hhw
2 2
+ a3 Vhw + a4 t + a5 D + a6 2
(21)
fnew (x *) = f (µ x ) + 2 Trace x*
* x xT
* * x*=µ x
* where ai, i = 1, …, 6 are the coefficients of the polynomial model, Hhw
µf (x *) T µ f (x * ) is the head-wave height, Vhw is the head-wind speed, t is the trim, D is
+ x* =µ x x* .
x* * x*
x *=µ x (18) the draft, and δ is the rudder angle. Table 3 shows the quantitative
*
comparison between these three regression models.
In the standard GP framework, the input variables are assumed to For the training dataset, the GP model without regularization per-
have no uncertainty, and the uncertainty in the output function is only forms better than the GP with regularization. However, applying the
considered. However, this study suggests considering the environ- regularization scheme provides more accurate results on the test da-
mental uncertainties in the input uncertainty x , and the effect of the taset. This confirms that both GP models outperform the polynomial
*
uncertain inputs on the output function is represented as an increased
uncertainty of the output function fnew .
2
Table 3
3.2.2. Engine power Error comparison for the ship speed model.
Eq. (15) can be rewritten as Model RMSE (kn) NRMSE (%)
PB V
= C1 n + C2 Training Test Training Test
d5n3 (19)
GP w/o regularization 0.17 0.49 1.14 3.35
where
GP w/ regularization 0.23 0.33 1.56 2.23
C1 N (µC1 , 2 2 Polynomial 0.59 0.63 4.00 4.31
C1 ), C2 N (µC2 , C2 ).
6
B. Yoo, J. Kim Applied Ocean Research 82 (2019) 1–9
Fig. 12. Comparison between the actual measurement data and the valued estimated by the regression model on test dataset for the engine power.
Table 4
Error comparison for the engine power model
Model RMSE (kW) NRMSE (%)
model and the regularization technique helps to avoid overfitting, Fig. 14. Estimated uncertainty of ship speed before and after considering the
which leads to the improved regression performance. environmental uncertainty.
7
B. Yoo, J. Kim Applied Ocean Research 82 (2019) 1–9
Fig. 17. Probability distributions of the engine power varying with environ-
mental conditions.
Fig. 15. Probability distributions of the ship speed varying with environmental
conditions.
Acknowledgement
References
8
B. Yoo, J. Kim Applied Ocean Research 82 (2019) 1–9
5957/JOSR.59.3.150012. [26] T.I. Fossen, Guidance and Control of Ocean Vehicles, John Wiley & Sons Inc., 1994.
[13] A. Coraddu, M. Figari, S. Savio, Numerical investigation on ship energy efficiency [27] J.E. Kerwin, J.B. Hadler, Principles of Naval Architecture Series: Propulsion, The
by Monte Carlo simulation, Proc. Inst. Mech. Eng. Part M: J. Eng. Marit. Environ. Society of Naval Architects and Marine Engineers (SNAME).
228 (3) (2014) 220–234, https://doi.org/10.1163/187529988X00184. [28] L. Larsson, H. Raven, The Principles of Naval Architecture Series: Ship resistance
[14] B.P. Pedersen, J. Larsen, Prediction of full-scale propulsion power using artificial and Flow, Society of Naval Architects and Marine Engineers (SNAME).
neural networks, Proceedings of the 8th International Conference on Computer and [29] S.C. Misra, Design Principles of Ships and Marine Structures, CRC Press, 2015.
IT Applications in the Maritime Industries (COMPIT’ 09), Budapest, Hungary May [30] T.D. Nielsen, F.V. Jensen, Bayesian Networks and Decision Graphs, Springer Science
(2009) 10–12. & Business Media, 2009, https://doi.org/10.1177/1475090214540874.
[15] J.P. Petersen, D.J. Jacobsen, O. Winther, Statistical modelling for ship propulsion [31] C. Bishop, Pattern Recognition and Machine Learning (Information Science and
efficiency, J. Mar. Sci. Technol. 17 (1) (2012) 30–39, https://doi.org/10.1007/ Statistics), 1st edn. corr. 2nd printing edn., Springer, New York, 2006.
s00773-011-0151-0. [32] C.E. Rasmussen, C.K. Williams, Gaussian Processes for Machine Learning vol. 1, MIT
[16] B. Yoo, J. Kim, Powering performance analysis of full-scale ships under environ- Press, Cambridge, 2006, https://doi.org/10.1142/S0129065704001899.
mental disturbances, IFAC-PapersOnLine 50 (1) (2017) 2323–2328, https://doi. [33] W. Hackbusch, Iterative Solution of Large Sparse Systems of Equations vol. 95,
org/10.1016/j.ifacol.2017.08.474. Springer, 1994.
[17] A. Radonjic, K. Vukadinovic, Application of ensemble neural networks to prediction [34] R.G. Dean, R.A. Dalrymple, Water Wave Mechanics for Engineers and Scientists vol.
of towboat shaft power, J. Mar. Sci. Technol. 20 (1) (2015) 64–80, https://doi.org/ 2, World Scientific Publishing Co Inc., 1991.
10.1007/s00773-014-0273-2. [35] A.H. Monahan, The probability distribution of sea surface wind speeds. Part I:
[18] S. Pétursson, Predicting Optimal Trim Configuration of Marine Vessels With Respect Theory and seawinds observations, J. Clim. 19 (4) (2006) 497–520.
to Fuel Usage, Master's thesis in University of Iceland, 2009. [36] J. Kim, M. Tandale, P. Menon, Modeling air-traffic service time uncertainties for
[19] C. Jian, Z. Jiayuan, X. Feng, Y. Jianchuan, Z. Zaojian, Y. Hao, X. Tao, Y. Luchun, queuing network analysis, IEEE Trans. Aerosp. Electron. Syst. 48 (1) (2012)
Parametric estimation of ship maneuvering motion with integral sample structure 525–541, https://doi.org/10.1109/TAES.2012.6129653.
for identification, Appl. Ocean Res. 52 (2015) 212–221, https://doi.org/10.1016/j. [37] A. Girard, C.E. Rasmussen, R. Murray-Smith, Gaussian process priors with uncertain
apor.2015.06.007. inputs: multiple-step ahead prediction, Technical Report TR-2002-119, Department
[20] X.-R. Hou, Z.-J. Zou, Parameter identification of nonlinear roll motion equation for of Computing Science, University of Glasgow, 2002, https://doi.org/10.1177/
floating structures in irregular waves, Appl. Ocean Res. 55 (2016) 66–75, https:// 1475090214540874.
doi.org/10.1016/j.apor.2015.11.007. [38] A. Girard, C.E. Rasmussen, J.Q. Candela, R. Murray-Smith, Gaussian process priors
[21] M. Zhu, A. Hahn, Y.-Q. Wen, A. Bolles, Identification-based simplified model of with uncertain inputs application to multiple-step ahead time series forecasting,
large container ships using support vector machines and artificial bee colony al- Advances in Neural Information Processing Systems, (2003), pp. 545–552, https://
gorithm, Appl. Ocean Res. 68 (2017) 249–261, https://doi.org/10.1016/j.apor. doi.org/10.1177/1475090214540874.
2017.09.006. [39] D.C. Montgomery, E.A. Peck, G.G. Vining, Introduction to Linear Regression
[22] J. Shawe-Taylor, N. Cristianini, Kernel Methods for Pattern Analysis, Cambridge Analysis vol. 821, John Wiley & Sons, 2012.
University Press, 2004. [40] J.F. Kenney, E. Keeping, Linear regression and correlation, Math. Stat. (1962)
[23] C.K. Williams, Prediction with Gaussian processes: from linear regression to linear 252–285.
prediction and beyond, Learning in Graphical Models, Springer, 1998, pp. 599–621. [41] H.J. Seltman, Experimental Design and Analysis, (2012).
[24] J. Kocijan, R. Murray-Smith, C.E. Rasmussen, A. Girard, Gaussian process model [42] D.M. Lane, D. Scott, M. Hebl, R. Guerra, D. Osherson, H. Zimmer, An Introduction to
based predictive control, American Control Conference, 2004. Proceedings of the Statistics, Citeseer, 2017.
2004, IEEE (2004) 2214–2219. [43] J. Wright, A. Colling, D. Park, Waves, Tides, and Shallow-Water Processes vol. 4,
[25] E.M. Constantinescu, M. Anitescu, Physics-based covariance models for Gaussian Gulf Professional Publishing, 1999.
processes with multiple outputs, Int. J. Uncertain. Quantif. 3 (1) (2013) 47–71.