Modeling and Optimization Methods for Controlling and Sizing Grid- Connected Energy Storage: A Review

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 10

See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/350326607

Modeling and Optimization Methods for Controlling and Sizing Grid-


Connected Energy Storage: A Review

Article in Current Sustainable/Renewable Energy Reports · March 2021


DOI: 10.1007/s40518-021-00181-9

CITATIONS READS

14 363

2 authors, including:

Di Wu
Pacific Northwest National Laboratory
105 PUBLICATIONS 3,430 CITATIONS

SEE PROFILE

All content following this page was uploaded by Di Wu on 24 June 2022.

The user has requested enhancement of the downloaded file.


Noname manuscript No.
(will be inserted by the editor)

Modeling and Optimization Methods for Controlling and


Sizing Grid-connected Energy Storage: A Review
Di Wu · Xu Ma

Received: date / Accepted: date

Abstract degradation effects explicitly considered in the decision-


making process. Advanced methods are to be devel-
Purpose of Review Energy storage is capable of provid- oped for effectively determining optimal BESS sizes
ing a variety of services and solving a multitude of issues that maximize overall benefits within a varying lifetime
in today’s rapidly evolving electric power grid. This pa- considering diversified system conditions, as well as un-
per reviews recent research on modeling and optimiza- certainties at planning and operational stages.
tion for optimally controlling and sizing grid-connected
battery energy storage systems (BESSs). Open issues Keywords Battery degradation · Bundled grid
and promising research directions are discussed. services · Energy storage · Modeling · Optimal
dispatch · Sizing · Stochastic optimization
Recent Findings Recent studies on BESS dispatch,
evaluation, and sizing focus on advanced modeling
and optimization methods to maximize stacked value 1 Introduction
streams from multiple services. BESS models have been
improved to better represent operational characteris- Battery energy storage systems (BESSs) are flexible
tics or capture degradation effects. Different solution and scalable, and can respond instantaneously to un-
methods and optimization techniques have been pro- predictable variations in demand and generation. They
posed to improve the benefits and cost-effectiveness of can provide a variety of services for bulk energy, an-
BESSs, using deterministic approaches prevalently but cillary, transmission, distribution, and customer energy
with impressive progress in capturing and addressing management [1, 2]. The development and deployment
uncertainties. of grid-connected BESSs have been gathering momen-
tum, especially with the increasing penetration of re-
Summary Recent progress in BESS scheduling and siz- newable generation. As the technology has advanced
ing better supports planning and operational decision- [3], many demonstrations and deployments have been
making in different use cases, which is highly impor- realized [4], and the regulatory structure is emerging
tant to advance the deployment of BESSs. Additional [5]. For example, the Federal Energy Regulatory Com-
research is required to properly model the trade-off be- mission (FERC) issued Order 755 in 2011, requiring
tween short-term benefits and service life with multiple ISO/RTO markets to compensate resources that can
provide faster-ramping frequency regulation. As a re-
This material is based upon work supported by the U.S. De-
sult, 75% of large-scale battery storage power capac-
partment of Energy (DOE), Office of Electricity through the
Energy Storage program. Pacific Northwest National Labora- ity in the U.S. provided frequency regulation in 2018.
tory is operated for the DOE by Battelle Memorial Institute In February 2018, FERC issued Order 841 to further
under Contract DE-AC05-76RL01830. remove barriers that had prevented the efficient de-
Pacific Northwest National Laboratory ployment of battery storage resources [6]. Clearly, de-
Richland, Washington, 99352, USA veloping less expensive and safer storage devices with
E-mail: di.wu@pnnl.gov longer cycle life is of great importance. There are quite
2 Di Wu, Xu Ma

a number of facilities demonstrating the technical feasi- on loss of life and degradation in performance, affect-
bility of storage technologies, but few of these are truly ing strategies of using a BESS for grid services over its
cost-effective commercial ventures. Value streams must service life. Note that in addition to battery storage, a
be identified and appropriately monetized. Considering BESS also includes other elements, such as monitor and
the cost of a battery at current market rates, it will control, protection, thermal management, and power
become necessary to capture multiple value streams si- conversion systems. In BESS scheduling and evalua-
multaneously for a project to be financially viable. tion studies, black- or grey-box models at the system
Optimal dispatch and sizing considering bundled level are generally preferred over individual component
services is the key to maximize benefits and enhance models to avoid unnecessary details, maintain modeling
cost-effectiveness of BESSs. Economic benefits of a simplicity, and improve computational efficiency.
BESS highly depend on its operational characteristics A BESS can be represented as a dynamical system
and physical capability. Charging control could be ex- with two kinds of state variables to capture temporal
tremely complicated due to the competition among var- interdependency of charging/discharging operations:
ious services for limited power and energy capacity,
– State of charge (SOC) or energy state is a state vari-
not only on a time step but also intertemporally–more
able that is used to describe the fast dynamics of
energy discharged in the current hour, less is avail-
present energy level.
able for future hours. In addition, battery charging
– Several state of health (SOH) or degradation state
and discharging profiles have a direct impact on the
variables are used to describe the slow dynamics of
battery degradation and loss of life. Frequent charg-
capacity loss associated with battery aging.
ing/discharging helps increase short-term benefits but
accelerates degradation. Optimal strategies are needed Modeling methods for representing operational char-
to maximize total economic benefits within the bat- acteristics and capturing degradation effects are sum-
tery lifetime, considering multiple degradation effects marized and classified as follows. Existing studies are
in the decision-making process. The problem becomes grouped by BESS modeling method in Table 1.
even more complicated when a BESS needs to be opti-
mally sized with an objective to not only maximize the
net benefits, but also consider resilience performance. 2.1 Operational Models
When incorporating uncertainties into BESS schedul-
ing and sizing in addition to capturing diversified sys- BESS operational models describe how a BESS can be
tem conditions, these problems become extremely chal- operated using charging/discharging power and SOC.
lenging to solve due to the complexity of uncertainty SOC is defined as the ratio of present energy level
models and/or increased size of the optimization prob- to energy capacity (the usable energy from a fully
lem. charged BESS). The SOC dynamics characterize how
Many studies have been dedicated to this topic dur- the charging and discharging power affects future SOC.
ing the last few years. BESS models with different lev- A BESS’s charging/discharging power is limited by the
els of complexity and fidelity are proposed and used. rated power capacity and could also depend on SOC.
Problem formulation and solution methods largely de- BESS operational models can be classified into two
pend on applications of interest. This paper presents types that are described as follows.
taxonomies for classifying modeling and solution meth-
ods for grid-connected BESSs, reviews existing studies
2.1.1 Simplified linear systems
in the context of the taxonomies, and discusses open
issues and promising research directions. Most existing BESS scheduling and evaluation studies
are based on a scalar linear system that resembles a sim-
plified dynamics of energy state parameterized by static
2 Modeling Methods charging and discharging power limits, energy or SOC
limits, and constant efficiencies. These models are also
Technical characteristics and physical capability need characterized by static power and energy capabilities
to be appropriately modeled when scheduling, evaluat- that are independent of SOC. Some studies are based on
ing, or sizing a BESS for grid applications. For example, a constant round-trip efficiency (RTE) model to capture
the rated power capacity of a BESS limits its ability to electrical and other losses, such as [11,24,39]. However,
interact instantaneously with the grid. The energy ca- the same RTE with different one-way efficiencies may
pacity limits its capability to shift energy over time. The lead to different optimal operating schedules. More im-
charging and discharging profiles have a direct impact portantly, by using an RTE only, one cannot accurately
Modeling and Optimization Methods for Controlling and Sizing Grid-connected Energy Storage: A Review 3

Table 1 Existing studies grouped by BESS modeling methods


Degradation Effects
no loss-of-life full model
Operational simplified [7–30] [31–43] [44–46]
Characteristics high-fidelity [47–50] [51] [52]

estimate SOC during charging or discharging and there- characteristics of BESSs, the high-fidelity models can
fore could obtain an operating schedule that cannot be be linear systems that well represent varying efficien-
followed. Modeling one-way efficiencies is straightfor- cies, varying power capability, and SOC change rate as
ward using conditional expressions as shown in studies functions of power and SOC. These high-fidelity models
such as [15,35,43]. Nevertheless, the conditional expres- help improve accuracy but increase computational bur-
sions cannot be directly integrated into standard math- den and complexity when nonlinearity is introduced.
ematical programming. One common method to work
around this is to introduce two non-negative auxiliary
variables representing charging and discharging power
2.2 Degradation Models
and thereby capture losses associated with charging and
discharge separately. Simultaneous charging and dis-
Battery life is a measure of battery performance and
charging lead to “fictitious” consumption of energy in a
longevity, which can be quantified in two ways: calendar
BESS with non-ideal efficiencies. Such kind of solutions
and cycle life. Calendar life is the elapsed time before
are physically unrealizable. To address this problem,
a battery becomes unusable whether it is in active use
studies such as [13, 14, 38] introduce binary variables to
or inactive. It reflects a battery’s inherent degradation
avoid charging and discharging at the same time. An al-
over time. Cycle life is defined as the number of cycles
ternative method is to add complementarity constraints
a battery can perform before its nominal capacity falls
where the product of charging and discharging power
below a certain percentage of its initial rated capacity.
at any time must be equal to zero, as shown in [22].
It depends on several factors such as depth of charge,
Note that a solution with simultaneous charging and
discharging rate, and ambient temperature. Many ex-
discharging is not optimal for many practical applica-
isting studies for BESS scheduling and evaluation as-
tions because it causes unnecessary losses [19, 23]. In
sume fixed lifespan to capture calendar aging, without
those cases, binary variables and complementarity con-
explicitly modeling cycle aging. As a result, the value of
straints can be ignored, as adopted in many studies such
a BESS may be overestimated when the battery needs
as [8, 9, 44]. In cases where simultaneous charging and
to be retired earlier than its calendar life due to accel-
discharging could be an optimal solution, relaxation of
erated cycle aging. Degradation models describe how
complementarity constraints can be used [18, 53].
different operations affect the aging of cycle life, energy
capacity, and resistance of a BESS. Most scheduling
2.1.2 High-fidelity systems and evaluation studies that involve degradation models
are based on simplified loss-of-life calculation. There
The simplified scalar linear model is easy to use but sub- are few studies that employ models to fully capture ag-
ject to several disadvantages and limitations. First, the ing effects, including degradation in performance. Two
power capability generally depends on SOC, but is com- types of degradation models are summarized as follows.
pletely ignored in the simplified models. In addition,
the rate of change of SOC depends on not only charg-
ing/discharging power but also SOC. Furthermore, the 2.2.1 Loss-of-life models
charging/discharging efficiency also varies with SOC
and power, whereas constant efficiencies are assumed The cycle life of a battery can be measured using ei-
in the simplified models. Several studies are dedicated ther (a) total amount of energy in kWh that can flow
to building generalized high-fidelity models into BESS throughout it or (b) the number of times it can be
scheduling and evaluation. The high-fidelity models can cycled before it needs to be replaced. The loss-of-life
be a set of lookup tables or analytical expressions, as calculation depends on multiple factors, such as num-
reported in [47–50,52]. Such types of models can be con- ber of cycles, depth of cycles, and amount of energy
structed using manufacturer’s specifications, test data, charged and discharged. When capturing loss of life as-
or existing empirical models. Regression techniques are sociated with different charging and discharging opera-
commonly used to generate lookup tables or determine tions, almost all existing studies introduce an aging or
modeling parameters [50]. Note that depending on the degradation cost to transform the long-term installation
4 Di Wu, Xu Ma

cost to the short-term operational cost. In practice, ir- capability to deviate from the scheduled baseline. Due
regular charging-discharging cycles make it difficult to to the temporal interdependency of BESS operations,
count the number of life cycles and the corresponding multi-period optimization is almost a must. The prob-
energy throughput. Approximation methods are typi- lem formulation and solution methods largely depend
cally used. Given the lifetime throughput energy, the on the nature of the problem. This section summarizes
degradation cost per kWh of discharged energy can be different use cases, problem types, solution methods,
estimated [34, 35]. Alternatively, given the number of and optimization techniques in existing BESS schedul-
cycles to failure at different depth of discharge (DOD), ing, evaluation, and sizing studies. Table 2 groups these
the corresponding degradation cost per cycle can be cal- studies by problem type, number of applications, and
culated [32, 43]. Aging cost can also be approximated solution method.
as a piecewise linear function of charging/discharging
power [31, 39], DOD [38, 40, 42], or both [35].
3.1 Use Cases
2.2.2 Full degradation models
While a BEES can provide bundled grid and end-user
In addition to loss of life, charging and discharging op- services, many studies focus on a single application,
erations over time also slowly impact the performance such as [13, 51, 55] on energy arbitrage or energy cost
of a BESS, including reduced capacity and increased reduction, [15,34] on microgrid cost reduction, and [56]
resistance, and thereby affect how a BESS will be used on frequency regulation. Considering the cost of bat-
in future years and the corresponding benefits. The fad- teries at current market rates, value streams from mul-
ing capacity and growing loss could significantly affect tiple applications are extremely important for a BESS
BESS scheduling strategies and evaluation results, but project to be financially viable. Scheduling and evalu-
have not been well considered in charging control in ation of a BESS to capture stacked value streams has
existing studies. Some studies such as [44, 46] explic- been a focus during the past few years. Energy arbi-
itly model dynamics of energy capacity to more ac- trage and frequency regulation are the two applications
curately calculate degradation cost or limit the num- that are often considered simultaneously for grid-scale
ber of cycles within the calendar life. Other works such BESSs in existing studies such as [11, 37, 39]. As for
as [45] evaluate BESS capacity degradation via a post- behind-the-meter services, energy and demand charge
processing step. An existing degradation-cost-based reduction are commonly considered together [16, 20].
dispatch strategy can prevent charging/discharging op- There are also studies that bundle three or more ser-
erations with benefits less than the cost associated with vices at the same time such as [9,24,31]. Several papers
loss of life, but does not necessarily maximize the total such as [27, 29, 41] are dedicated to the use of BESSs to
benefits over a BESS’s useful lifetime. In other words, simultaneously generate economic benefits and improve
the degradation effects are not appropriately modeled system resilience.
to capture the reduced benefits in future years as an
opportunity cost of cycling a BESS to maximize short-
term benefits. 3.2 Problem Types

From the perspective of time frame, existing studies can


3 Use Cases and Optimization Methods be classified into two groups:
– short-term operation (scheduling and dispatch)
The benefits from a BESS depend on how it is sched-
– long-term planning (evaluation and sizing)
uled and dispatched to provide different services. The
operational flexibility and degradation models describe In operational scheduling studies such as [22,38,43,47],
feasible charging and discharging operations. Charging model predictive control (MPC) problems are formu-
control needs to be designed to optimally use a BESS to lated over a short period of time, typically a day, to
maximize the total benefits from multiple grid services make charging/discharging decisions at each time step.
in both operational scheduling and long-term planning This type of studies focus on BESS scheduling and dis-
studies. Requirements and rules could be very differ- patch methods, without any cost-benefit analysis over
ent from one service to another. Objective functions a long term or battery life. Nevertheless, these meth-
and constraints need to be designed to properly model ods can be used to repeatedly schedule and simulate
each service in different use cases. In addition, it is also BESS hourly and daily operations over one or multi-
necessary to capture the coupling among different ser- ple representative years and thereby to estimate the
vices and their dependence on scheduled operation and present value of net benefits. Such a strategy is popular
Modeling and Optimization Methods for Controlling and Sizing Grid-connected Energy Storage: A Review 5

Table 2 Existing studies grouped by problem type, number of applications, and solution method.
Mathematical Programming Other Methods
Deterministic Stochastic Deterministic Stochastic
Operational single application [18, 32, 34] [13, 22, 38] [12, 19, 21] [35, 43, 51]
Scheduling multiple applications [7, 23, 31, 46, 47] [17, 24, 40] [48, 49] [25, 37]
Evaluation single application [14, 44] [10, 36] [33, 42] [26, 28, 54]
or Sizing multiple applications [9, 11, 15, 16, 39] [27, 29] [20, 30, 48, 50] [41, 45]

in many BESS evaluation studies, such as [9, 11, 39, 50]. in many existing studies such as [9, 39, 44, 46]. Often,
Some other evaluation studies such as [11,16] formulate binary variables are introduced to represent generator
the value assessment problem as an optimization by ex- on/off and battery charging/discharging status as well
plicitly modeling BESS operations over a longer period as the selection of options in different use cases, re-
(such as a month or year) in which diversified loading sulting in mixed-integer LP problems, such as the ones
conditions and varying prices are captured. formulated in [14, 29, 38]. There are also studies based
While rated capacity and maximum charging are on convex optimization such as quadratic programming
given in optimal scheduling and evaluation studies, siz- in [7], second-order cone programming [18], and conic
ing problems aim to identify the optimal BESS sizes programming [22].
to maximize the net benefits, considering the trade-off Dynamic programming (DP) and reinforcement
between benefits and cost. Optimal dispatch and/or learning (RL) are also used for BESS scheduling and
charging/discharging control rules are generally in- evaluation, especially when nonlinear characteristics
volved to capture how the net-benefits vary with BESS and constraints are involved. While the original engi-
size. These problems are generally more challenging to neering problems are described by continuous variables,
solve. To simplify the problem, simplified linear opera- DP and RL find approximate solutions in the discrete
tion models are commonly used. In addition, degrada- space. In these methods, BESS scheduling and eval-
tion effects are not considered, or simply represented uation problems are formulated as a Markov decision
by degradation cost functions. To further simplify the process: At each time step, given the current SOC, a
problem, many sizing studies such as [14, 15, 44] only BESS is charged/discharged according to a control pol-
consider a short time frame or a few operation snap- icy and transits into a new SOC. The goal is to find a
shots instead of a large number of diversified system charging control policy that maximizes the cumulative
operating conditions. benefits. Examples that are based on DP algorithms in-
clude [35,49,50]. To solve the curses of dimensionality of
DP, approximated dynamic programming (ADP) algo-
3.3 Solution Methods
rithms have been proposed in [26,28] for energy storage
Value from a BESS depends on how it is used. It is de- scheduling problems. While DP algorithms are model-
sirable to find the best way to charge and discharge a based, RL can be seen as model-free or sample-based.
BESS and thereby maximize the economic benefits from Several RL algorithms have been developed for BESS
one or multiple applications. Optimization problems scheduling [43, 51].
need to be formulated and solved based on BESS op- MPC is a standard method used to perform itera-
erational characteristics and degradation models while tive and finite-horizon optimal dispatch of a BESS. One
capturing the coupling among different applications. main advantage of MPC is that the model prediction
There are different approaches for optimally schedul- allows to formulate system constraints explicitly in the
ing and sizing a BESS. optimal control policy design. At each time step, one
Most existing studies are based on mathematical solves a finite-horizon optimal dispatch problem online
programming methods, where the scheduling and siz- and updates system states. The iterative scheduling and
ing problems are formulated as standard programming dispatch process helps implicitly address uncertainties
problems (e.g., linear and convex programming) and to some degree. Such a strategy has been employed in
then solved using off-the-shelf solvers. While almost all many studies, such as [9, 47, 48].
of these problems involve nonlinear terms and logical As for BESS sizing, one popular method is to for-
expressions, optimization modeling techniques such as mulate standard mathematical programming problems
piecewise linear approximation, convex relaxation, and in which BESS energy and power capacity are treated
Big-M method can be used to generate their linear or as decision variables and the net benefits become the
convex equivalents or approximation. Linear program- objective function to be maximized [14, 16, 44]. Bilevel
ming (LP) is the most popular method that is used optimization is an another approach for optimal sizing
6 Di Wu, Xu Ma

[30, 54], where the lower-level evaluation of a given size cent years to make decisions in a distributed manner
of BESS is embedded within the upper-level size search- or to address uncertainties, especially for operational
ing problem. Searching algorithms such as gradient- scheduling. While distributed control can help to over-
based methods, particle swarm optimization, and ge- come disadvantages of centralized control, additional
netic algorithm are often used at the upper level. Ana- efforts are required to develop more robust and effi-
lytical approaches have also been proposed for BESS cient algorithms. Incorporating uncertainty at both the
sizing in existing studies, such as [20, 42], based on long-term planning stage and the short-term opera-
an objective quantitative analysis of cost and benefits. tional stage into evaluation and sizing would enhance
Such kinds of methods identify key factors that affect the understanding of practically achievable BESS ben-
optimal sizing and directly link the optimal sizes to in- efits, is yet to be developed. This would require compu-
put parameters. tationally efficient multi-stage stochastic optimal sizing
Note that a large body of literature is based on methods with uncertainties at different stages properly
deterministic methods using historical or representa- modelled.
tive system data, without explicitly modeling and ad- One important problem that is largely ignored in
dressing uncertainties associated with system load, re- the literature is how to optimally distribute battery cy-
newable generation, and prices. In practice, schedul- cle life over years. Degradation cost associated with loss
ing and sizing decisions need to be made under un- of battery life is well considered in the existing litera-
certainties. Stochastic programming [24, 43], chance- ture. The optimal dispatch is determined by maximiz-
constrained optimization [36, 40], ADP [26, 28], and ing the difference between the revenue and the corre-
robust optimization [17, 38] are popular methods for sponding degradation cost within a day or a year. One
handling uncertainties in BESS scheduling and sizing main disadvantage of such kinds of methods is that they
problems. Reference [57] provides stochastic optimiza- do not necessarily maximize the total benefits over a
tion canonical modeling framework and four fundamen- BESS’s useful lifetime. For example, using these meth-
tal classes of policies that encompass all the compet- ods, a BESS may be cycled in some hours even though
ing solution approaches. In addition to centralized ap- the returned revenue is just slightly higher than the
proaches where a single control center gathers infor- degradation cost. The battery life could be saved for
mation from and provides control signals to the entire future more profitable operations. In other words, the
system, a number of distributed alternatives have been degradation-cost-based dispatch methods fail to model
proposed for BESS operational scheduling [12, 19, 21]. the temporal interdependency of the use of a BESS over
In these algorithms, each coordination agent only main- its useful lifetime and tends to overuse a BESS in early
tains a set of variables and updates them through in- years, leading to suboptimal solutions. It seems that
formation exchange with a few neighbors. coupling SOC and SOH dynamics need to be modeled
for maximize the benefits from a BESS. In addition,
strategies and rules need to be developed to guide op-
4 Discussion
erational scheduling considering the loss of potential
Most existing studies focus on formulating BESS gain from high-value services in future years.
scheduling, evaluation, and sizing problems into stan-
dard mathematical programming through innova-
tive linearization or relaxation methods. Simplified
BESS models are commonly used. Optimal charg- 5 Conclusions
ing/discharging methods based on more accurate non-
linear models are studied less often. Modeling meth- In this paper, we provided an overview and critical re-
ods to fully capture degradation effects are under- view of existing modeling and optimization methods for
explored. How to explicitly build high-fidelity models BESS scheduling, evaluation, and sizing. Existing mod-
and degradation effects into sizing process remains an els for describing BESS operational characteristics and
open question. Even with simplified BESS models, siz- degradation effects were summarized, classified, and
ing problems are computationally intensive and difficult compared. The advantages and shortcomings of differ-
to solve. This is why many sizing studies only consider ent modeling methods were highlighted. In addition,
a short time frame or a few operation snapshots that existing studies were grouped based on problem type,
cannot fully represent diversified system operating con- number of applications, and solution method. Key solu-
ditions. tion methods and optimization techniques were summa-
While centralized deterministic methods are preva- rized. Finally, we discussed open issues and promising
lent, promising methods have been developed in re- research directions.
Modeling and Optimization Methods for Controlling and Sizing Grid-connected Energy Storage: A Review 7

6 Compliance with Ethical Standards 10. Atia, R., Yamada, N.: Sizing and analysis of renew-
able energy and battery systems in residential micro-
6.1 Conflict of interest grids. IEEE Transactions on Smart Grid 7(3), 1204–1213
(2016). DOI 10.1109/TSG.2016.2519541
11. Byrne, R.H., Concepcion, R.J., Silva-Monroy, C.A.: Es-
The authors declare that they have no conflict of inter- timating potential revenue from electrical energy stor-
est. age in PJM. In: Proceedings of the IEEE Power and
Energy Society General Meeting, pp. 1–5 (2016). DOI
10.1109/PESGM.2016.7741915
12. Fang, H., Wu, D., Yang, T.: Cooperative management
6.2 Human and Animal Rights and Informed Consent of a lithium-ion battery energy storage network: A dis-
tributed MPC approach. In: Proceedings of the IEEE
This article does not contain any studies with human Conference on Decision and Control, 4226-4232. Las Ve-
gas, NV (2016). DOI 10.1109/CDC.2016.7798911
or animal subjects performed by any of the authors.
13. Fang, X., Li, F., Wei, Y., Cui, H.: Strategic scheduling
of energy storage for load serving entities in locational
Acknowledgements We are grateful to Imre Gyuk, who marginal pricing market. IET Generation, Transmission
is the Director of Energy Storage Research in the Office of & Distribution 10(5), 1258–1267 (2016). DOI 10.1049/
Electricity at the U.S. Department of Energy, for providing iet-gtd.2015.0144
financial support and leadership on this and other related 14. Fernandez-Blanco, R., Dvorkin, Y., Xu, B., Wang, Y.,
work at Pacific Northwest National Laboratory. Kirschen, D.S.: Optimal energy storage siting and sizing:
A WECC case study. IEEE Transactions on Sustainable
Energy PP(99), 1–1 (2016). DOI 10.1109/TSTE.2016.
2616444
References 15. Sharma, S., Bhattacharjee, S., Bhattacharya, A.: Grey
wolf optimisation for optimal sizing of battery energy
1. Hesse, H.C., Schimpe, M., Kucevic, D., Jossen, A.: storage device to minimise operation cost of microgrid.
Lithium-ion battery storage for the grid—A review of IET Generation, Transmission & Distribution 10(3),
stationary battery storage system design tailored for ap- 625–637 (2016). DOI 10.1049/iet-gtd.2015.0429
plications in modern power grids. Energies 10(12) (2017). 16. Wu, D., Kintner-Meyer, M., Yang, T., Balducci, P.: Eco-
DOI 10.3390/en10122107 nomic analysis and optimal sizing for behind-the-meter
2. Balducci, P., Alam, J., Hardy, T., Wu, D.: Assigning battery storage. In: Proceedings of the IEEE Power and
value to energy storage systems at multiple points in an Energy Society General Meeting, pp. 1–5. Boston, MA
electrical grid. Energy & Environmental Science 11(8), (2016). DOI 10.1109/PESGM.2016.7741210
1926–1944 (2018). DOI 10.1039/C8EE00569A 17. Kazemi, M., Zareipour, H., Amjady, N., Rosehart, W.D.,
3. Koohi-Fayegh, S., Rosen, M.: A review of energy storage Ehsan, M.: Operation scheduling of battery storage sys-
types, applications and recent developments. Journal of tems in joint energy and ancillary services markets.
Energy Storage 27, 101047 (2020). DOI 10.1016/j.est. IEEE Transactions on Sustainable Energy 8(4), 1726–
2019.101047 1735 (2017). DOI 10.1109/TSTE.2017.2706563
4. U.S. Department of Energy: DOE OE global energy 18. Marley, J.F., Molzahn, D.K., Hiskens, I.A.: Solving mul-
storage database. https://www.sandia.gov/ess-ssl/ tiperiod OPF problems using an AC-QP algorithm ini-
global-energy-storage-database-home/ tialized with an SOCP relaxation. IEEE Transactions
5. Twitchell, J.: A review of state-level policies on elec- on Power Systems 32(5), 3538–3548 (2017). DOI
trical energy storage. Current Sustainable/Renewable 10.1109/TPWRS.2016.2636132
Energy Reports 6(2), 35–41 (2019). DOI 10.1007/ 19. Wu, D., Yang, T., Stoorvogel, A.A., Stoustrup, J.: Dis-
s40518-019-00128-1 tributed optimal coordination for distributed energy re-
6. U.S. Energy Information Administration: Battery stor- sources in power systems. IEEE Transactions on Au-
age in the United States: An update on market trends, tomation Science and Engineering 14(2), 414–424 (2017).
July 2020. https://www.eia.gov/analysis/studies/ DOI 10.1109/TASE.2016.2627006
electricity/batterystorage/pdf/battery_storage. 20. Wu, D., Kintner-Meyer, M., Yang, T., Balducci, P.: Ana-
pdf lytical sizing methods for behind-the-meter battery stor-
7. Ratnam, E.L., Weller, S.R., Kellett, C.M.: An age. Journal of Energy Storage 12, 297–304 (2017). DOI
optimization-based approach to scheduling residen- 10.1016/j.est.2017.04.009
tial battery storage with solar PV: Assessing customer 21. Cherukuri, A., Cortés, J.: Distributed coordination of
benefit. Renewable Energy 75, 123–134 (2015). DOI DERs with storage for dynamic economic dispatch.
10.1016/j.renene.2014.09.008 IEEE Transactions on Automatic Control 63(3), 835–842
8. Wogrin, S., Gayme, D.F.: Optimizing storage sit- (2018). DOI 10.1109/TAC.2017.2731809
ing, sizing, and technology portfolios in transmission- 22. Fang, X., Hodge, B., Bai, L., Cui, H., Li, F.: Mean-
constrained networks. IEEE Transactions on Power Sys- variance optimization-based energy storage scheduling
tems 30(6), 3304–3313 (2015). DOI 10.1109/TPWRS. considering day-ahead and real-time LMP uncertainties.
2014.2379931 IEEE Transactions on Power Systems 33(6), 7292–7295
9. Wu, D., Jin, C., Balducci, P., Kintner-Meyer, M.: An en- (2018). DOI 10.1109/TPWRS.2018.2852951
ergy storage assessment: Using optimal control strategies 23. Hao, H., Wu, D., Lian, J., Yang, T.: Optimal coordination
to capture multiple services. In: Proceedings of the IEEE of building loads and energy storage for power grid and
Power and Energy Society General Meeting, pp. 1–5. end user services. IEEE Transactions on Smart Grid 9(5),
Denver, CO (2015). DOI 10.1109/PESGM.2015.7285820 4335–4345 (2018). DOI 10.1109/TSG.2017.2655083
8 Di Wu, Xu Ma

24. Namor, E., Sossan, F., Cherkaoui, R., Paolone, M.: Con- multi-scale dynamic programming. IEEE Transactions
trol of battery storage systems for the simultaneous pro- on Smart Grid 9(3), 1997–2005 (2018). DOI 10.1109/
vision of multiple services. IEEE Transactions on Smart TSG.2016.2605141
Grid 10(3), 2799–2808 (2019). DOI 10.1109/TSG.2018. 38. Correa-Florez, C.A., Michiorri, A., Kariniotakis, G.: Ro-
2810781 bust optimization for day-ahead market participation of
25. Sedighizadeh, M., Esmaili, M., Jamshidi, A., smart-home aggregators. Applied Energy 229, 433–445
Ghaderi, M.H.: Stochastic multi-objective economic- (2018). DOI 10.1016/j.apenergy.2018.07.120
environmental energy and reserve scheduling of mi- 39. Foggo, B., Yu, N.: Improved battery storage valuation
crogrids considering battery energy storage system. through degradation reduction. IEEE Transactions on
International Journal of Electrical Power & Energy Sys- Smart Grid 9(6), 5721–5732 (2018). DOI 10.1109/TSG.
tems 106, 1–16 (2019). DOI 10.1016/j.ijepes.2018.09.037 2017.2695196
26. Shuai, H., Fang, J., Ai, X., Tang, Y., Wen, J., He, H.: 40. Xu, Y., Zhao, T., Zhao, S., Zhang, J., Wang, Y.: Multi-
Stochastic optimization of economic dispatch for micro- objective chance-constrained optimal day-ahead schedul-
grid based on approximate dynamic programming. IEEE ing considering BESS degradation. CSEE Journal of
Transactions on Smart Grid 10(3), 2440–2452 (2019). Power and Energy Systems 4(3), 316–325 (2018). DOI
DOI 10.1109/TSG.2018.2798039 10.17775/CSEEJPES.2016.01050
27. Balducci, P., Mongird, K., Wu, D., Wang, D., Fotedar, 41. Zhou, J., Tsianikas, S., Birnie, D.P., Coit, D.W.: Eco-
V., Dahowski, R.T.: An evaluation of the economic nomic and resilience benefit analysis of incorporating bat-
and resilience benefits of a microgrid in Northampton, tery storage to photovoltaic array generation. Renewable
Massachusetts. Energies 13 (2020). DOI 10.3390/ Energy 135, 652–662 (2019). DOI 10.1016/j.renene.2018.
en13184802. 4802 12.013
28. Das, A., Ni, Z., Zhong, X., Wu, D.: Experimental valida- 42. Bahloul, M., Khadem, S.K.: An analytical approach for
tion of approximate dynamic programming based opti- techno-economic evaluation of hybrid energy storage sys-
mization and convergence on microgrid applications. In: tem for grid services. Journal of Energy Storage 31,
Proceedings of the IEEE Power and Energy Society Gen- 101662 (2020). DOI 10.1016/j.est.2020.101662
eral Meeting (2020) 43. Shang, Y., Wu, W., Guo, J., Ma, Z., Sheng, W., Lv, Z.,
29. Wu, D., Ma, X., Huang, S., Fu, T., Balducci, P.: Stochas- Fu, C.: Stochastic dispatch of energy storage in micro-
tic optimal sizing of distributed energy resources for a grids: An augmented reinforcement learning approach.
cost-effective and resilient microgrid. Energy 198 (2020). Applied Energy 261 (2020). DOI 10.1016/j.apenergy.
DOI 10.1016/j.energy.2020.117284. 117284 2019.114423. 114423
30. Zhu, J., Chen, L., Wang, X., Yu, L.: Bi-level optimal
44. Hamedi, A., Rajabi-Ghahnavieh, A.: Explicit degrada-
sizing and energy management of hybrid electric propul-
tion modelling in optimal lead–acid battery use for pho-
sion systems. Applied Energy 260, 114134 (2020). DOI
tovoltaic systems. IET Generation, Transmission & Dis-
10.1016/j.apenergy.2019.114134
tribution 10(4), 1098–1106 (2016). DOI 10.1049/iet-gtd.
31. Hu, W., Wang, P., Gooi, H.B.: Assessing the economics of
2015.0163
customer-sited multi-use energy storage. In: IEEE Region
45. Alharbi, H., Bhattacharya, K.: Stochastic optimal plan-
10 Conference (TENCON), pp. 651–654 (2016). DOI
ning of battery energy storage systems for isolated mi-
10.1109/TENCON.2016.7848083
32. Ju, C., Wang, P.: Energy management system for mi- crogrids. IEEE Transactions on Sustainable Energy 9(1),
crogrids including batteries with degradation costs. In: 211–227 (2017). DOI 10.1109/TSTE.2017.2724514
IEEE International Conference on Power System Tech- 46. Braeuer, F., Rominger, J., McKenna, R., Fichtner, W.:
nology (POWERCON), pp. 1–6 (2016). DOI 10.1109/ Battery storage systems: An economic model-based anal-
POWERCON.2016.7754011 ysis of parallel revenue streams and general implications
33. Liu, Y., Du, W., Xiao, L., Wang, H., Bu, S., Cao, J.: Siz- for industry. Applied Energy 239, 1424–440 (2019). DOI
ing a hybrid energy storage system for maintaining power 10.1016/j.apenergy.2019.01.050
balance of an isolated system with high penetration of 47. Kim, S.K., Kim, J.Y., Cho, K.H., Byeon, G.: Opti-
wind generation. IEEE Transactions on Power Systems mal operation control for multiple BESSs of a large-
31(4), 3267–3275 (2016). DOI 10.1109/TPWRS.2015. scale customer under time-based pricing. IEEE Trans-
2482983 actions on Power Systems 33(1), 803–816 (2017). DOI
34. Bordin, C., Anuta, H.O., Crossland, A., Gutierrez, I.L., 10.1109/TPWRS.2017.2696571
Dent, C.J., Vigo, D.: A linear programming approach for 48. Copp, D.A., Nguyen, T.A., Byrne, R.H.: Adaptive model
battery degradation analysis and optimization in offgrid predictive control for real-time dispatch of energy storage
power systems with solar energy integration. Renewable systems. In: Proceedings of the IEEE American Control
Energy 101, 417–430 (2017). DOI 10.1016/j.renene.2016. Conference, pp. 3611–3616. IEEE (2019). DOI 10.23919/
08.066 ACC.2019.8814902
35. Abdulla, K., de Hoog, J., Muenzel, V., Suits, F., Steer, 49. Nguyen, T.A., Copp, D.A., Byrne, R.H., Chalamala,
K., Wirth, A., Halgamuge, S.: Optimal operation of en- B.R.: Market evaluation of energy storage systems in-
ergy storage systems considering forecasts and battery corporating technology-specific nonlinear models. IEEE
degradation. IEEE Transactions on Smart Grid 9(3), Transactions on Power Systems 34(5), 3706–3715 (2019).
2086–2096 (2018). DOI 10.1109/TSG.2016.2606490 DOI 10.1109/TPWRS.2019.2909764
36. Akhavan-Hejazi, H., Mohsenian-Rad, H.: Energy stor- 50. Wu, D., Balducci, P., Crawford, A., Mongird, K., Ma,
age planning in active distribution grids: A chance- X.: Building battery energy storage system performance
constrained optimization with non-parametric probabil- data into an economic assessment. In: Proceedings of the
ity functions. IEEE Transactions on Smart Grid 9(3), IEEE Power and Energy Society General Meeting (2020)
1972–1985 (2018). DOI 10.1109/TSG.2016.2604286 51. Cao, J., Harrold, D., Fan, Z., Morstyn, T., Healey, D.,
37. Cheng, B., Powell, W.B.: Co-optimizing battery storage Li, K.: Deep reinforcement learning-based energy storage
for the frequency regulation and energy arbitrage using arbitrage with accurate lithium-ion battery degradation
Modeling and Optimization Methods for Controlling and Sizing Grid-connected Energy Storage: A Review 9

model. IEEE Transactions on Smart Grid 11(5), 4513–


4521 (2020). DOI 10.1109/TSG.2020.2986333
52. Fortenbacher, P., Mathieu, J.L., Andersson, G.: Model-
ing, identification, and optimal control of batteries for
power system applications. In: Proceedings of the IEEE
Power Systems Computation Conference, pp. 1–7. IEEE
(2014). DOI 10.1109/PSCC.2014.7038360
53. Li, Z., Guo, Q., Sun, H., Wang, J.: Extended sufficient
conditions for exact relaxation of the complementar-
ity constraints in storage-concerned economic dispatch.
CSEE Journal of Power and Energy Systems 4(4), 504–
512 (2018). DOI 10.17775/CSEEJPES.2016.01120
54. Nasrolahpour, E., Kazempour, S.J., Zareipour, H., Rose-
hart, W.D.: Strategic sizing of energy storage facilities
in electricity markets. IEEE Transactions on Sustain-
able Energy 7(4), 1462–1472 (2016). DOI 10.1109/TSTE.
2016.2555289
55. Wankmüller, F., Thimmapuram, P.R., Gallagher, K.G.,
Botterud, A.: Impact of battery degradation on energy
arbitrage revenue of grid-level energy storage. Journal
of Energy Storage 10, 56–66 (2017). DOI 10.1016/j.est.
2016.12.004
56. Stroe, D., Knap, V., Swierczynski, M., Stroe, A., Teodor-
escu, R.: Operation of a grid-connected lithium-ion bat-
tery energy storage system for primary frequency regula-
tion: A battery lifetime perspective. IEEE Transactions
on Industry Applications 53(1), 430–438 (2017). DOI
10.1109/TIA.2016.2616319
57. Powell, W.B., Meisel, S.: Tutorial on stochastic opti-
mization in energy–Part I: Modeling and policies. IEEE
Transactions on Power Systems 31(2), 1459–1467 (2016).
DOI 10.1109/TPWRS.2015.2424974

View publication stats

You might also like