Professional Documents
Culture Documents
Multi-Agent Optimal Allocation of Energy Storage Systems in Distribution Systems
Multi-Agent Optimal Allocation of Energy Storage Systems in Distribution Systems
fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TSTE.2017.2705838, IEEE
Transactions on Sustainable Energy
1949-3029 (c) 2016 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TSTE.2017.2705838, IEEE
Transactions on Sustainable Energy
focuses on the interest of only one resource or multiple allocation. The proposed solving algorithm achieves the
resources owned by one agent. In a multi-agent system, the Nash equilibrium effectively.
competition and interaction among different BESS owners The content of this paper is organized as follows. After the
change the cost-benefit results significantly. To address such a Introduction section, the operational model of the distribution
challenge in planning processes, a comprehensive BESS system with multiple agents is presented. Next, we formulate
allocation method and operation strategy should take the the non-cooperative game for the BESS allocation problem
interactions among agents into account rather than focusing on and prove the existence of a Nash equilibrium and dominant
the independent agent’s behavior individually. Game theory is strategy. Subsequently, the solving algorithm is introduced.
a powerful tool to analyze such interactions and competitions Case studies are conducted and simulation results are analyzed
and provide a solution to the complicated allocation problem to validate the performance of the proposed planning method.
in a distributed manner. A game theoretic approach is used to The conclusions and future work are discussed in the last
formulate an energy consumption scheduling game for a
section.
demand-side energy management system in [11]. Based on the
users’ preferences and energy consumption patterns models, a
II. OPERATIONAL MODEL OF MULTI-AGENTS
Vickrey-Clarke-Groves (VCG) mechanism is applied in [11]
to guarantee the efficiency of the proposed scheduling method A. System Model
and to reduce the information collection. In addition to the In this paper, a distribution system is managed by a number
application in demand-side management, game theory has of agents serving the demand or operating the distributed
received increasing attention in many other aspects of power generation. With high renewable energy penetration, DISCOs
systems. A game theoretic model is proposed for multiple have the ability to sell excess energy to the electricity markets.
virtual power plants dispatch [12] where various distributed The DISCO is also considered as a leader agent that is
generations and battery storage devices are considered responsible for making the energy bid in the day-ahead market
simultaneously. The interactions and energy trading decisions and balancing the real power consumption in real-time market.
of distributed storage units are studied using a novel game The DISCO obtains forecasted energy consumption or
theoretic framework [13]. Game theory is also introduced for a generation schedule information submitted by follower agents
planning problem to construct a grid-connected hybrid power for the next 24 hours. Next, the DISCO bids in the day-ahead
system comprised of renewable energy and storage batteries market according to the forecasted net demand. The system
[14]. Inspired by the good performances of game theory in the
net demand Pnet can be computed as
investigation of multiple agents’ behavior, we propose an
n n
P G
extended energy transaction mechanism in a distribution (1)
Pnet i i
system and formulate a non-cooperative game for multiple i 1 i 1
agents to determine their own battery installation plan. The
where Pi and Gi are the power consumption and generation of
main contributions of this paper are summarized as follows:
The distributed renewable energy generation and demand agent i , respectively; n is the total number of agents. We
are modeled as different agents in a future distribution assumed all the loads and generations are served by agents.
system. We extend the energy transaction mechanism in Because of the uncertainties of renewable energy and demand,
the power market for these agents in the distribution the net demand cannot be forecasted with a high accuracy.
system to encourage them to track the forecasted energy Thus, the DISCO must compensate for the gap between the
consumption and generation and allow reduction of the actual demand and the expected one in the real-time market,
energy purchasing cost. resulting in high risk of energy transaction. In the PJM market,
We apply a multi-state stochastic model to assess the if the actual load deviates from the day-ahead purchasing, the
forecast errors of renewable energy and demand. A DISCO should pay charges (known as the congestion fee) at
discrete model is formed from the continuous probability the real-time price. Therefore, BESS is applied to track the net
distribution functions of various resources. The expected
demand profile for power transaction risk mitigation [9].
transaction risks caused by the forecast errors are
In this paper, the distributed resources and the demand are
quantified using the stochastic model.
A non-cooperative game is formulated to represent the operated by different agents rather than a DISCO. The market
optimization problem of maximizing the individual utility mechanism is extended in such a system for the transaction
function of each agent with a BESS. In this way, the between the DISCO and the follower agents. The procured
agents’ behavior and the interactions among them can be energy in a day-ahead market is allocated to the agents
investigated. according to the submitted energy information. Similar to the
The desired properties of the battery installation game are transaction of a DISCO in the electricity market, the agents are
analyzed in this work. First, the unique existence of the punished if the energy consumed or generated in real time is
Nash equilibrium is proved. Next, the truth declaration is different to the submitted one. For simplicity, we assumed that
proved to be the dominant strategy of agents which each agent serves one type of resources. As shown in Fig.1,
guarantees the efficiency of the proposed mechanism and three groups of agents are modeled in this paper: namely, wind
solution algorithm. agents, solar agents and demand agents. It is assumed that the
The simulation results verify that both DISCO and billing system of the DISCO is budget-balanced and the
distributed agents can benefit from optimal BESS balancing cost (penalty) in the real-time market is transferred
1949-3029 (c) 2016 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TSTE.2017.2705838, IEEE
Transactions on Sustainable Energy
to the agents. Thus, the penalty charged to each agent can be where Pi bess is the charging power of the BESS installed by
determined as follows: agent i ; Si is the BESS capacity of agent i ; is the rating
BESS of
power/capacity ratio of the BESS considered in this paper.
Distribution Company Electricity markets
Thus, Si represents the rating charging/discharging power.
DISCO
Distribution network Next, the net power gapof the agent with BESS becomes
Pi' Pi Pibess , i N / 0 (5)
Agent 1 Agent n1 Agent n1+1 Agent n1+n2 Agent n1+n2+1 Agent n1+n2+n3
Wind farm 1 ... Wind farm n Solar station ... Solar station Demand aggregator ... Demand aggregator
For the DISCO, a BESS is installed for energy balancing at
BESS of
agent1
BESS of
agent n
BESS of
agent n1+1
BESS of
agent n1+n2
BESS of agent
n1+n2+1
BESS of agent
n1+n2+n3
the substation site. As proposed in [9], the strategy is to track
the forecasted demand profile. The charging/discharging
Power flow Information exchange
signals are set as
Fig.1. Proposed operation framework for DISCOs.
P , S0 P0
P0bess 0 (6)
DISCO (leader agent) S0 , else
The leader agent is budget-balanced to the penalty and
where the forecast error of the leader P0 is calculated by
operated as an interface between the follower agents and the
market. The penalty charged by the power market is varied in n
different market mechanisms. In this paper, such penalty is P0 P . Next, the net power gap of DISCO with BESS
i 1
i
'
Pi i 1
i n 0 , i N / 0 (3)
where '0 and i' are the system penalty cost and the penalty
i 1
Pi
cost described to agent i , respectively; '0 is calculated as
where i and Pi are the penalty cost and forecast error of P0' p t .
agent i , respectively.
To mitigate the risk of penalty in the energy transaction B. Forecast uncertainties
process, the agents have incentives to install BESS. The Wind speed
integration of BESS provides more choices for the agents and Research has proven that a two-parameter Weibull
the DISCO in an energy market. The agents are able to probability distribution function closely matches the random
balance the real-time energy gap optimally via the energy characteristic of wind speed [15]. The probability density
market or the BESS owned by them. Note that the penalty function is given as:
price in the real-time market is higher than the kv v
kv 1
v kv
f v v exp (9)
charging/discharging cost of BESS. Therefore, the leader cv cv cv
agent can make a profit from charging/discharging its own
battery to meet the demand gap while the follower agents Given the probability of wind speed forecast error, the wind
power distribution is acquired [16]. The linear transformation
apply the batteries to avoid the risks given by eq. (3). The
is described as
benefit-cost analysis of each agent with BESS is performed as
w bw 1
described below. f w v fv (10)
The follower agents perform energy procurement from the aw aw
DISCO or sell the excess generation to the DISCO. They face where f v v and f w v are the forecast error probability
the risk of being levied a penalty as a result of a local forecast
error. To minimize the penalty cost, the agents install their density function (PDF) of wind speed and wind power,
own BESS to track their forecasted energy profile. According respectively; w and v are the wind power and wind speed,
to the battery charging/discharging strategy, respectively ; kv , cv , aw , and bw are all parameters of the
P , Si Pi probability function.
Pi bess i (4) Solar forecast uncertainty
Si , else
The uncertainty of solar radiation mainly comes from the
stochastic nature of the weather condition. A cleanness index
1949-3029 (c) 2016 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TSTE.2017.2705838, IEEE
Transactions on Sustainable Energy
is adopted to address the problem [17][18]. The random the local information and broadcasted information from the
behavior of the clearness index is expressed by a Beta other agents. It is important to guarantee the agents have
distribution function. incentives to install BESS and declare their true information
(ak bk ) ak 1 during the information updating process. The cost and the
f cl kt kt (1 k t )b1 (11)
(ak )(bk ) benefits of BESS installation for each agent are analyzed in
this section. In the proposed algorithm, the network model is
where f cl kt is the PDF of the clearness index; kt is the
neglected and the optimization is performed in a restricted
clearness; ak and bk are the Beta parameters. situation. This assumption is common in a system taking
Load forecast uncertainty power market effect into account. Under this assumption, the
A Gaussian distribution fl l is used in this paper to location of BESS has not impact on the convexity of the
model. In other word, there is only a single variable for each
statistically model the load forecast error [18]. The PDF for a agent, namely the total BESS capacity.
Gaussian distribution is:
A. Cost and benefits analysis
1 l l 2 (12)
fl l exp 2
According to the conclusion stated in report [19], the
2 l2 2 l battery cost can be represented by the summation of fixed cost
where l and l are the statistical mean and standard deviation and flexible charging/discharging cost if the BESS is operated
in a reasonable depth of discharge (DOD). Therefore,the
of the load demand, respectively.
expected hourly BESS charging/discharging cost is expressed
C. Multi-state stochastic model as
For calculation simplicity, the continuous forecast error
ci k fix Si kc / d Si E Pi bess , i N (16)
distributions given by Eqs. (10)-(12) are expressed in a multi-
state model. The energy forecast errors are discretized into where ci is the expected hourly BESS cost of agent i ; k fix is
several levels with fixed steps. The probability and cumulative the hourly maintenance cost factor; the flexible part is
probability at each level are calculated according to the calculated according to the expected absolute
probability density functions for each agent. The multi-state charging/discharging amount Pi bess and the
forecast uncertainty model (MSFU) of the agents is expressed
as charging/discharging cost factor kc / d ; E () is used in this
M i j, pi j , Pi ( j ); j 1, 2,..., m (13) paper to represent the expectation value. In particular, the
expected BESS cost could be quantified by using the MSFU
where M i is the MSFU of agent i ; m is the state number of the
model. This quantification is achieved as follows:
forecast error in the MSFU; j indicates the discrete forecast
ci pi ( j ) k fix Si kc / d Si Pi bess ( j )
m
(17)
error state and the forecast error of state j , Pi ( j ) is calculated j 1
1949-3029 (c) 2016 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TSTE.2017.2705838, IEEE
Transactions on Sustainable Energy
E Pi' (20) peak is around 0 [21-23]. For simplicity, the peaks of PDFs
i , i N / 0 used in this paper are 0 and follow certain distribution
E P
n
'
i function introduced in the above section.The convexity of the
i 1
payoff functions of the leader agent and follower agents will
where i is the expected penalty cost of agent i ; E Pi' and be discussed by part A and part B, respectively.
(a) For the leader player, the forecast error PDF follows
E P are the expected forecast error of agent i
n
' and all Gaussian distribution. For clearance, we denote x0 , x0' and r0
i
i 1 for the original forecast error, forecast error with BESS and
agents, respectively. The penalty cost of an agent is the BESS power capacity of the leader agent. According to
proportional to its expected forecast error. Therefore, the 0, r0 x0 r0
utility functions of the follower agents can be expressed as
eq.(4), we have x0 x0 r0 , x0 r0 . The PDF and
'
total payments ui , x r , x r
0 0 0
ui i +ci
0
(21)
cumulative distribution function (CDF) of the leader agent
B. Non-cooperative game model forecast error are shown in Fig.2. The penalty cost function
with BESS can be expressed as follows.
The above-described distributed optimization problem is
x
1
modeled as a non-cooperative game for the agents in the 0 (r0 ) p E x0' '
0 f 0 x0 dx0
system to determine their optimal plans for installing BESS. 1
r0
2) Strategy: The decisions of the players determine the x0 f 0 x0 dx0 r0 F r0 F 1
capacity of the BESS. Thus, we define the strategy sets for the 1
p 1
players as S {S0 , S1 , S2 ,..., Sn } . Constraints reflect the
x0 f 0 x0 dx0 r0 F 1 F r0
technology and the investment limit; thus,the strategies are set
r0
within a reasonable space, Smin Si Smax , i 1, 2,..., n ,which
0 (r0 ) r0 f 0 r0 +r0 f 0 r0 F r0
is non-empty, convex, and compact. p
3) Payoff functions: The payoff functions of the players are the r0 r0 f 0 r0 +r0 f 0 r0 1+F0 r0 (25)
same as the utility functions presented above. The mappings p F0 r0 1+F0 r0
are expressed as
ui : S0 S1 S2 Sn for i 0,1, 2,..., n (22) 20 (r0 )
p f 0 r0 +f 0 r0 (26)
2 r0
C. Nash Equilibrium
Where f0 is the forecast error PDF expressed as
The players select the optimal strategies to minimize their
r , 2
F0 is the corresponding CDF.
payoff functions. We denote the strategy variables Si* , i N f 0 r0
1
exp 0 2
as the Nash equilibrium [20] of the game if and only if 2 2
0 2 l
ui (Si* ; S*i ) ui (Si ; S*i ), i N , Si 0 (23) Then we have f0 r0 0 , f 0 r0 0 for 0 r0 1 . Thus, the
where S are the strategy variables of agents except i at the
*
i
second order derivative of 0 (r0 ) is positive for 0 r0 1 . It
Nash equilibrium. If the players apply the BESS plans at the can be easily deduced that the second order derivative of
Nash equilibrium in this game, no one would benefit by u0 c0 +0 is positive for 0 r0 1 . Base on this result, we can
unilaterally changing the installation plan. The existence and conclude that the payoff function of leader player is strict
uniqueness of the Nash equilibrium of the proposed game are convex within the range of BESS power capacity.
proven as follows.
It should be noted that most of the forecast error
distributions are located within a conditional range and its
1949-3029 (c) 2016 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TSTE.2017.2705838, IEEE
Transactions on Sustainable Energy
F0 r0
x0 x0' x0
x0 x0' r0 x0 x0' r0
F0 r0
ui
E Pi' effect. at is a forecast error value where tail effect exists. It is
E P
+ci (27) reasonable that investing a high capacity is not an economic
E Pi' '
i solution.
Similar to part (a), we denote xi , xi' and ri for the original D.Dominant strategy
forecast error, forecast error with BESS and BESS power In the proposed optimal BESS planning game, the players
capacity of the follow agent. Let g (ri ) denote the expected are asked to broadcast their energy capacity, forecasting
value of the absolute output error of player i , E Pi' . As a accuracy, and the latest BESS allocation plan. We define the
true information and the declared information as eqs. (29) and
result, eq.(27) is transformed to (30), respectively.
g ri I i M i , Si (29)
ui a +b (28)
g ri Ii Mˆ , Sˆ
i i (30)
where a, b are constants larger than 0. The peak of the follower
where I i and Iˆi are the true and declared information of agent
agents' PDF are all assumed to be 0. The convexity of g ri
can be proven as part (a). when the BESS power capacity is i , respectively; Cˆ i , Mˆ i , and Sˆi are the broadcasted value of
smaller than the maximum output error, eq. (28) is also strictly the privacy information.
convex because the function is monotonically increasing to If the player declares untruthful data or an untruthful plan to
g ri and g ri is strictly convex. This indicates the payoff the system, then the other players may be misled and suffer
from loss in the payoff function. The arbitrary information
functions of the followers are strictly convex. Typical payoff
system will harm the efficiency of the proposed game and
function curve of the wind farm player is simulated, as shown
decrease the benefit of some participants. Therefore, it is
in fig. 3.
important to guarantee that truthful declaration is the dominant
strategy for each player. Vickrey–Clarke–Groves(VCG)
auction guarantees truthfulness[20]. The demonstration of this
dominant strategy is given as follows.
Given a wind farm player and a DISCO, the wind farm can
apply the strategy of over declaration or under declaration on
the demand gap. If the declared demand gap is different to the
true one, then the DISCO has the incentive to change the
BESS capacity in Nash equivalent, i.e., S0 ( Iˆ1 ) S0 ( I1 ) .
* *
1949-3029 (c) 2016 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TSTE.2017.2705838, IEEE
Transactions on Sustainable Energy
contrast, the under declaration will cause an increase of total distribution system is shown in Fig. 4.
penalty that is obviously also not beneficial to the payoff. TABLE I
The result proves the player cannot gain by cheating in the TYPICAL PARAMETERS OF LEAD-ACID
proposed game. We assume that the players are rational and Item Lead-acid Battery
do not know how many players are taking part in the game. Maximum charging current 0.5 C
Therefore, truthful declaration is a dominant strategy for each k fix 10 $/MWh/hour
player. This proposition guarantees the efficiency of the game kc / d 80 $/MWh
and facilitates the solution algorithm that will be proposed in
the next section. ...
Wind aggregator
(follower player 1)
...
equilibrium exists and truthful declaration is the dominant Solar aggregator
(follower player 2)
strategy for each agent. Therefore, the multiply distributed
...
optimization algorithm is suitable for solving the proposed Physic power network Broadcast network
problem. The algorithm finds the Nash equilibrium iteratively Fig.4. 4-player distribution system
using the best response technique [26, 27]. The details are
specified as below: We apply the historical hourly data and the forecast tool to
acquire the forecast error data. According to the probability
Distributed Algorithm distribution function, the fitting functions for wind power,
solar power, and demand are obtained. Next, the multi-state
Step 1: Input the system data and parameters.
stochastic models are calculated for different agents, as shown
Step 2: Initialize the strategy for each agent randomly.
in Fig.5.
Step 3: Search the Nash equilibrium iteratively.
For comparison, we first perform the base scenario with no
Solve the best response of the optimization BESS integration. In this scenario, the DISCO is budget-
problem in turn, namely, for i 0 : n balanced and the expected total penalty cost is $149.52/hour.
Si arg max ui Si The expected forecast errors for the wind agent, solar agent
and demand agent are 0.4825, 0.2220, and 0.2520,
Update the self-information and broadcast the
respectively. The penalty cost is shared among these follower
strategy across the system.
agents according to the expected error. Therefore, the
Step 4: Repeat step 3 until no agent declares new strategy. expected payoff values of wind, solar, and demand are
Step 5: Output the strategy vectors as the Nash equilibrium. 75.4237, 34.7027, and 39.3923 $/hour, respectively.
0.2
0.1
In this section, we present case studies and assess the
0.05
performance of the proposed BESS allocation method. In our
simulation, the electricity price and battery parameters are set 0
-0.9 -0.8 -0.7 -0.6 -0.5 -0.4 -0.3 -0.2 -0.1 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9
wind foracast error
as in [8]. The historical data were downloaded from website 0.2
[28]. The forecast tool box used for the data process was 0.15
probability
A. Case A. 0.05
0
The IEEE 11kV, 15-bus radial distribution system applied -0.9 -0.8 -0.7 -0.6 -0.5 -0.4 -0.3 -0.2 -0.1 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9
solar foracast error
in [9] is modified into a system with four agents, namely 0.2
DISCO agent, wind agent, solar agent, and demand agent. The 0.15
probability
wind agent owns two 850kW wind machines and one 800kW 0.1
machine. The fourteen loads are supplied by the demand 0.05
aggregator. The peak demand is 3.14MW. A 1.8 MW solar 0
farm is operated by the solar aggregator. The penalty price is -0.9 -0.8 -0.7 -0.6 -0.5 -0.4 -0.3 -0.2 -0.1 0 0.1 0.2
demand forecast error
0.3 0.4 0.5 0.6 0.7 0.8 0.9
$0.5/kWh. We choose a common lead-acid model of BESS Fig.5. Multi-state stochastic model of different agents in the distribution
designed for energy balancing. The energy capacity to power system
capacity ratio is 2 hours. The battery cost is nearly
After the calculation in the base scenario, the proposed
proportional to the power rating and the capacity rating of the
distributed optimization algorithm is performed for BESS
battery. The power capacity of energy storage station is a
allocation. The distributed optimization is conducted from the
major concern in this work. The other index of ESS is
first agent to the last agent. At each agent’s turn, it will
produced according to the capacity which is proportional to
optimize the BESS size to maximize its utility. Next, the
the ones of standard cell. The charging current, cost
updated information will be broadcast to the other agents and
parameters are shown in Table I. The structure of this
1949-3029 (c) 2016 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TSTE.2017.2705838, IEEE
Transactions on Sustainable Energy
the algorithm continues until no agent presents a new plan. and 1 leader agent (i.e., the DISCO). The energy capacities of
The utility of each agent is fuzzified to show the convergence different agents are chosen from the following set
of the proposed algorithm clearly [30]. The fuzzy rule is 1,0.5,1.5wind , 0.5,0.7,1solar , 0.3,0.5,0.7,0.8,1demand . As
shown as follows:
the number of agents increases, the calculation of the expected
ui S ui (S * ) total net demand becomes very time consuming. To reduce the
ui (S ) fori 0,1, 2,3 (29)
uimax uimin computation burden, we can use the observation that the errors
of the same resource are positively correlated. This
From fig.6, the steady state is achieved after 12 iterations. assumption is correct in a small distribution system due to the
At steady state, the Nash equilibrium is formed for every similar weather condition. The total BESS integration plan
participating agent; at this state, no agent can benefit from changes with the optimization iteration until the Nash
changing the plan. equilibrium is reached. The curve of the convergent process is
shown in Fig, 7. From the curve, we can find that the
Wind agent’s turn
0.4
convergent process only requires 24 iterations. The optimal
0.2
BESS allocation results of the Nash equilibrium are given in
0
Table IV. The cost and benefits comparisons of the follower
Fuzzfied utility
-0.2
-0.4 Convergent state agents are shown in Fig.8. The results show that not every
-0.6
agent can make a profit through the BESS installation.
Disco agent
-0.8 Total However, if the agent does not participate in the proposed
Demand agent
-1 Wind agent BESS allocation scheme, it will face higher risk in the energy
Solar agent
0 2 4 6 8 10 12 14 16 18
transaction processes. This phenomenon, caused by the
Iteration Number
competition effect among agents, is an important issue in the
Fig.6. Fuzzified utility of different agents through the optimization process proposed BESS allocation method. The agent has incentive to
TABLE II
NASH EQUILIBRIUM OF BESS ALLOCATION
participate because the BESS installation of other agents could
Based Scenario Optimal Result increase its transaction risk in power market. In other word,
BESS the utility improvement of an agent without BESS could be
Item Energy/Power negative which provides incentive for the participant to adopt
Utility($/hour) Payoff($/hour)
Capacity it.
(MWh/MW)
7
Leader
DISCO 0 0.88/0.44 5.282
Agent 6
Agents
Demand agent 39.3923 0.75/0.375 37.5528 4
TABLE III 3
DETAIL OPERATION COST WITH BESS OF DIFFERENT AGENTS
2
Wind agent 19.3816 38.042 16.2 Fig.7. Fuzzified utility of different agents through the optimization process.
Solar agent 7.7845 18.1 7.5
Demand agent 10.2528 19.8 7.5 TABLE IV
NASH EQUILIBRIUM OF BESS ALLOCATION
The utility improvements and BESS allocation results are Optimal Result
listed in Table II. Compared with the base scenario, all the Utility
Item
BESS Energy Capacity (MWh) Improvement
agents can benefit from the BESS integration. The details of ($/hour)
the utility are shown in Table III. Although the cost of BESS Leader
is very high, the penalty saving is adequate to compensate for DISCO 1.7 14.2056
Agent
the charging/discharging cost. As the technology development 1 0.5 0.215
of BESS progresses, the cost will further decrease, thereby Wind agent 2 0.2 -0.0821
enhancing the economic feasibility of the proposed method. 3 0.7 0.1329
Moreover, the total BESS installation capacity is higher than 1 0.3 0.0959
Solar agent 2 0.4 0.1668
the result in our previous work [9]. This difference shows that
3 0.5 0.3546
the Nash equilibrium of noncooperative game may not be the 1 0.1 0.0039
global optimal result. 2 0.2 0.1088
Demand
3 0.3 0.2137
B. Case B. agent
4 0.5 0.5245
A more comprehensive case study is performed in this part 5 0.4 0.7482
to test the feasibility and convergence rate of the proposed
BESS allocation method for multiple agents. We assume there
are 12 agents, 3 wind agents, 3 solar agents, 5 demand agents,
1949-3029 (c) 2016 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TSTE.2017.2705838, IEEE
Transactions on Sustainable Energy
15
(0.5C, 1C), the third BESS is Lithium-Ion with 0.5C charging
current. The fixed costs k fix are 10, 15, 20 $/MWh/h and the
10
operation cost are 80, 80, 150 $/MWh. The simulation results
5
are shown in Fig. 10. The utility improvements of agents with
0 different BESS type are compared in Table VII. It is obvious
1 2 3 4 5 6 7 8 9 10 11
Agent that the BESS cost is a great barrier, and it is important to
Fig.8. Cost and benefit of a follower agent at the Nash equilibrium optimal allocate BESS capacity to the agents. In the scenario
with Lithium-Ion battery, the investment of BESS is not
C. Sensitivities analysis profitable. Along with development of battery technology, the
In order to show the effeteness of the proposed method, the costs of battery will decrease, which makes the BESS more
above two case studies are performed in a extreme scenario feasible for reducing energy transaction risk.
with high forecast errors and penalty price. As the penalty 2
Lead-acid 0.5C
price, forecast error as well as BESS unit cost are important Lead-acid 1C
Li-ion 0.5C
exogenous baseline factors that construct the environment for
Forecast error
For evaluating the impacts of forecast errors on the BESS 0.5
Battery Cost Fig.11. Optimal BESS allocations in different penalty price scenarios
1949-3029 (c) 2016 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TSTE.2017.2705838, IEEE
Transactions on Sustainable Energy
TABLE VIII [9] Y. Zheng, Z. Y. Dong, F. J. Luo, K. Meng, J. Qiu, and K. P. Wong,
UTILITY IMPROVEMENT COMPARISONS OF DIFFERENT PENALTY PRICE ($/HR) "Optimal Allocation of Energy Storage System for Risk Mitigation of
Penalty Price Scenario DISCOs With High Renewable Penetrations," Power Systems, IEEE
Agent Transactions on, vol. 29, pp. 212-220, Jan. 2014.
High Medium Low
[10] Y. Zheng, Z. Y. Dong, K. Meng, F. J. Luo, H. Q. Tian, and K. P. Wong,
Wind agent 1.80 1.32 1.03
"A control strategy of battery energy storage system and allocation in
Solar agent 1.32 1.01 0.88 distribution systems," in Power and Energy Society General Meeting
Demand agent 1.84 1.40 1.05 (PES), 2013 IEEE, 2013, pp. 1-5.
[11] P. Samadi, H. Mohsenian-Rad, R. Schober, and V. W. S. Wong,
"Advanced Demand Side Management for the Future Smart Grid Using
VI. CONCLUSION Mechanism Design," Smart Grid, IEEE Transactions on, vol. 3, pp. 1170-
1180, Sept. 2012.
An advanced BESS allocation method was proposed based [12] Y. Wang, X. Ai, Z. Tan, L. Yan, and S. Liu, "Interactive Dispatch Modes
onthe interactions among multiple agents during an energy and Bidding Strategy of Multiple Virtual Power Plants Based on Demand
Response and Game Theory," Smart Grid, IEEE Transactions on, vol. PP,
transaction process in a distribution system. In this method, pp. 510-519, Jan. 2016.
the agents have incentives to optimize their BESS installation [13] W. Yunpeng, W. Saad, H. Zhu, H. V. Poor, and T. Basar, "A Game-
plan to maximize the payoff. Through a game-theoretic Theoretic Approach to Energy Trading in the Smart Grid," Smart Grid,
approach, the agents reach a Nash equilibrium of BESS IEEE Transactions on, vol. 5, pp. 1439-1450, May 2014.
[14] M. Shengwei, W. Yingying, L. Feng, Z. Xuemin, and S. Zhenquan,
installation where no agents can benefit from changing the "Game Approaches for Hybrid Power System Planning," Sustainable
declaration plan. The results proved the economic feasibility Energy, IEEE Transactions on, vol. 3, pp. 506-517, July 2012.
and convergence of the proposed method. The transaction [15] M. R.Patel., Wind and Solar Power Systems: CRC Press LLC, 1999.
risks stemming from the forecast errors during energy [16] J. Hetzer, D. C. Yu, and K. Bhattarai, "An Economic Dispatch Model
Incorporating Wind Power," Energy Conversion, IEEE Transactions on,
transaction can be mitigated by optimal BESS allocation, vol. 23, pp. 603-611, June 2008.
thereby significantly improving the dispatch ability of [17] V. A. G. a. K. G. T. Hollands, "A method to generate synthetic hourly
renewable energy. The advantages of the proposed method solar radiation globally," Solar Energy, vol. 44, pp. 333–341, Jan. 1990.
over previous battery allocation methods are 1) extension of [18] Z. Kai, A. P. Agalgaonkar, K. M. Muttaqi, and S. Perera, "Distribution
System Planning With Incorporating DG Reactive Capability and System
the energy transaction mechanism to the distribution system to Uncertainties," Sustainable Energy, IEEE Transactions on, vol. 3, pp.
enable the competition and cooperation of the energy agents in 112-123, Jan. 2012.
the electricity market; 2) application of game theory to [19] “A guide to lead-acid batteries”, [Online]. Available:
investigate the behaviors of multiple agents and obtain an www.solar2renewableenergy.com.
[20] R. B. Myerson, Game theory: Harvard university press, 2013.
optimal solution at the Nash equilibrium; and 3) an efficient [21] K. Bruninx and E. Delarue, "A Statistical Description of the Error on
declaration system and stable optimal results for the agents. Wind Power Forecasts for Probabilistic Reserve Sizing," IEEE
With the integration of BESS, agents can mitigate the risk and Transactions on Sustainable Energy, vol. 5, pp. 995-1002, July 2014.
obtain more profits in the energy transaction process as the [22] N. Zhang, C. Kang, Q. Xia, and J. Liang, "Modeling Conditional Forecast
Error for Wind Power in Generation Scheduling," IEEE Transactions on
system integrates more intermittent renewable energy. Power Systems, vol. 29, pp. 1316-1324, May 2014.
[23] H. Bludszuweit, J. A. Dominguez-Navarro, and A. Llombart, "Statistical
REFERENCES Analysis of Wind Power Forecast Error," IEEE Transactions on Power
Systems, vol. 23, pp. 983-991, Aug. 2008.
[1] W. Zhimin, G. Chenghong, L. Furong, P. Bale, and S. Hongbin, "Active [24] A. H. Mohsenian-Rad, V. W. S. Wong, J. Jatskevich, R. Schober, and A.
Demand Response Using Shared Energy Storage for Household Energy Leon-Garcia, "Autonomous Demand-Side Management Based on Game-
Management," Smart Grid, IEEE Transactions on, vol. 4, pp. 1888-1897, Theoretic Energy Consumption Scheduling for the Future Smart Grid,"
July 2013. Smart Grid, IEEE Transactions on, vol. 1, pp. 320-331, Dec. 2010.
[2] J. Quanyuan, G. Yuzhong, and W. Haijiao, "A Battery Energy Storage [25] J. B. Rosen, "Existence and uniqueness of equilibrium points for concave
System Dual-Layer Control Strategy for Mitigating Wind Farm n-person games," Econometrica, vol. 33, pp. 347-351, 1965.
Fluctuations," Power Systems, IEEE Transactions on, vol. 28, pp. 3263- [26] A. S. Chuang, F. Wu, and P. Varaiya, "A game-theoretic model for
3273, Aug. 2013. generation expansion planning: problem formulation and numerical
[3] M. T. Lawder, B. Suthar, P. W. C. Northrop, S. De, C. M. Hoff, O. comparisons," Power Systems, IEEE Transactions on, vol. 16, pp. 885-
Leitermann, et al., "Battery Energy Storage System (BESS) and Battery 891, Nov. 2001.
Management System (BMS) for Grid-Scale Applications," Proceedings [27] Y. Narahari, Game theory and mechanism design: Singapore : IISc Press :
of the IEEE, vol. 102, pp. 1014-1030, May 2014. World Scientific 2014.
[4] P. Mercier, R. Cherkaoui, and A. Oudalov, "Optimizing a Battery Energy [28] CISL Research Data Archive [Online]. Available: http://rda.ecar.edu/.
Storage System for Frequency Control Application in an Isolated Power [29] (Sep. 2009). The OptiSeries V1.0 User Manual.
System," Power Systems, IEEE Transactions on, vol. 24, pp. 1469-1477, [30] M. F. Akorede, H. Hizam, I. Aris, and M. Z. A. Ab Kadir, "Effective
Aug. 2009. method for optimal allocation of distributed generation units in meshed
[5] S. Grillo, M. Marinelli, S. Massucco, and F. Silvestro, "Optimal electric power systems," Generation, Transmission & Distribution, IET,
Management Strategy of a Battery-Based Storage System to Improve vol. 5, pp. 276-287, Feb. 2011.
Renewable Energy Integration in Distribution Networks," Smart Grid,
IEEE Transactions on, vol. 3, pp. 950-958, June 2012.
[6] C. A. Hill, M. C. Such, C. Dongmei, J. Gonzalez, and W. M. Grady,
"Battery Energy Storage for Enabling Integration of Distributed Solar BIOGRAPHIES
Power Generation," Smart Grid, IEEE Transactions on, vol. 3, pp. 850- Yu Zheng (M’15) obtained his B.E and Ph. D degrees from Shanghai Jiao
857, June 2012. Tong University, China and The University of Newcastle, Australia, in 2009
[7] S. X. Chen, H. B. Gooi, and M. Q. Wang, "Sizing of Energy Storage for and 2015, respectively. He is now a senior research assistant at the University
Microgrids," Smart Grid, IEEE Transactions on, vol. 3, pp. 142-151, Mar. of Hong Kong, Hong Kong. His research interests include power electronic
2012. applied in power system, power system planning, and smart grid.
[8] C. Changsong, D. Shanxu, C. Tao, L. Bangyin, and H. Guozhen,
"Optimal Allocation and Economic Analysis of Energy Storage System in David J. Hill (S’72–M’76–SM’91–F’93–LF’14) received the Ph.D. degree in
Microgrids," Power Electronics, IEEE Transactions on, vol. 26, pp. electrical engineering from the University of Newcastle, Australia, in 1976.
2762-2773, Oct. 2011. He holds the Chair of electrical engineering in the Department of Electrical
1949-3029 (c) 2016 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI 10.1109/TSTE.2017.2705838, IEEE
Transactions on Sustainable Energy
Zhao Yang Dong (M’99–SM’06–F’17) obtained his Ph.D. degree from the
University of Sydney, Australia in 1999. He is now a Professor and the Head
of the School of Electrical and Information Engineering, University of Sydney,
Australia. He was previously the Ausgrid Chair and Director of the Center for
Intelligent Electricity Networks (CIEN), The University of Newcastle,
Australia, and is now a Conjoint Professor there. He also held academic and
industrial positions with Hong Kong Polytechnic University and Transend
Networks (now TASNetworks), Tasmania, Australia. His research interest
includes smart grid, power system planning, power system security, load
modeling, electricity market, and computational intelligence and its
application in power engineering. Prof. Dong is an editor of IEEE
Transactions on Smart Grid, IEEE Transactions on Sustainable Energy, IEEE
Power Engineering Letters, and IET Renewable Power Generation.
1949-3029 (c) 2016 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.