Professional Documents
Culture Documents
Multi-Agent Systems (MAS) Controlled Smart Grid - A Review: Mahesh S Narkhede S.Chatterji, Ph.D. Smarajit Ghosh, PH.D
Multi-Agent Systems (MAS) Controlled Smart Grid - A Review: Mahesh S Narkhede S.Chatterji, Ph.D. Smarajit Ghosh, PH.D
12
International Journal of Computer Applications (0975 – 8887)
International Conference on Recent Trends in engineering & Technology - 2013(ICRTET'2013)
storage with the aim of saving energy and reducing power plant and different DER by using Multi-agent system
carbon emissions. (MAS) technology. The authors designed a new three layered
• Integrating technological advances in transmission to MAS architecture with good generality useable in small,
control power flows (FACTS,SVC, etc.). medium and large scale multi-agent based distributed energy
system (MAS-DES). The authors presented the novel
architecture for single agent system with learning ability. The
3. TRENDS IN APPICATIONS OF MAS IN SG authors further claimed that proposed MAS-DES uses the
traditional and renewable resources in a more reasonable way
This section deals with the applications of MAS in Smart Grid.
and provides a better solution for the power supply considering
the cost, pollution index and reliability.
Stephen D. J. McArthur et al in [5] examined the potential value
of MAS technology to the power industry The authors further
A. Dimeas et al in [9]-[13] explained the capabilities offered by
described fundamental concepts and approaches within the field
MultiAgent System technology in the operation of a Microgrid.
of Multi-Agent Systems that are appropriate to power
The authors developed MAS based on Java Agent Development
engineering applications. Further the authors presented a
Framework (JADE) and tested it on the Microgrid in a Lab.. The
comprehensive review of the meaningful power engineering
authors further introduced a novel approach called multiagent
applications for which MAS are being investigated. They further
reinforcement learning in order to increase the intelligence and
defined the technical issues which must be addressed in order to
the efficiency of the Microgrid.
accelerate and facilitate the uptake of the technology within the
power and energy sector.
J. Oyarzabal et al in [14], reported a Micro Grid Management
system based on intelligent software agent technologies and its
H. J. Zhou et al in [6] analyzed advantages of the Multi-Agent
application to the effective management of generation & storage
systems and Software Oriented Architecture (MAS-SOA) design
devices connected to a LV network forming a microgrid. The
consideration and architecture in integration for intelligent
software modular architecture developed by authors enabled
distribution network. The authors realized the specific service
additional services for advanced control, such as the deployed
by encapsulating agent, which interacted with other agent
Generation secondary control system. The effectiveness and
services through the Enterprize Service Bus (ESB). The authors
applicability of the introduced software was evaluated in a
designed Web Service-Agent Adapter as the standard interface
laboratory environment where real generation, storage and load
between agent and the other services.
devices were being monitored and controlled. The authors
further also assessed performance and scalability issues related
After a critical analysis of application of MAS in Smart Grid. It
to the agent framework.
is observed that MAS technology has been applied to following
application areas in Smart Grid.
Zhenhua Jiang in [15], presented an agent-based control
framework for distributed energy resources microgrids. To
1) Demand Response
demonstrate the effectiveness of the proposed agent-based
2) Microgrid – Operation and Control
control framework, the authors performed simulation studies on
3) Service Restoration
a dc distributed energy system that can be used in a microgrid as
4) Smart Grid control
a modular power generation unit. Simulation studies
5) Spot Market Mechanism
demonstrated that the control agents manage the power of each
6) VPP control
energy source properly and the microgrid works reliably.
7) Economic Disptach
S. J. Chatzivasiliadis et al in [16], contributed to the
investigation of the benefits that distributed control can offer to
3.1 DEMAND RESPONSE future electricity grids. The authors described the first field test
of a Multi-Agent System in a Microgrid. They proposed a
Rehan Fazal et al in [7], proposed a combined dynamic demand possible low-cost approach for the maximization of the use of
response and DG management optimization system using multi- Renewable Energy Sources and environmental friendly
agents for a smart microgrid. With dynamic DR, The authors technologies in an electricity power supply grid.
considered impact of Critical Peak Pricing rates with the
penetration of PHEVs for smart microgrid. The authors further T. Logenthiran et al in [17], outlined an application of MAS for
proved that by using Multi-agent System and controlled distributed energy resource (DER) management in a MicroGrid.
charging system overloading can be avoided. Also, the proposed With the help of software simulation the authors demonstrated
system reduced overall cost of electricity by shifting loads to off that it is possible to apply a distributed coordination approach to
peak hours. The PHEVs in this scheme were charged depending coordinating distributed energy systems at the strategic level.
on their battery state of charge (BSOC). PHEVs with less BSOC
were charged on priority. From the results the authors further Zhang Jian et al in [18], discussed the framework of MAS and
proved that by controlling the charging of PHEVs along with presented an agent control model aiming at maximizing
the load shaping, the grid resources can be efficiently utilized to efficiency of Microgrid based on the idea of hierarchical
overcome the real time demand keeping in view the coordinated control. The authors discussed the coordination
unpredictable nature of wind source. control strategies of MAS. With the help of simulation an
example of a particular Microgrid was performed to
demonstrate the fact that the efficiency and reliability of
3.2 MICROGRID MANAGEMENT Microgrid can be improved by using MAS.
13
International Journal of Computer Applications (0975 – 8887)
International Conference on Recent Trends in engineering & Technology - 2013(ICRTET'2013)
grid-connected mode and the island mode. In the primary Massimo Cossentino et al in [27], proposed a MAS-based
control, autonomy of each agent was maximized to control the approach for the solution of the energy transportation problem
DERs without any communications based on certain levels of providing a system that is able to react to feeders overloading
learning process. and failures by redirecting the energy flow and protecting itself.
Tinghua Li et al in [20] , designed a simpler IP and multi-agent A.L. Kulasekera et al in [28], reviewed current research on the
technologies-based microgrid monitor and control system using application of multi-agent systems in microgrid schemes. The
the platforms of MATLAB and ZEUS, and discussed its authors mainly focused on recent developments of multi-agent
implementation. With the help of simulations , the authors systems in different aspects of microgrids such as control,
proved the feasibility of microgrid scheduling under the control market modeling, optimization and power restoration. The future
of MAS. directions of multi-agent systems in microgrid applications were
also discussed briefly.
T. Logenthiran, et al in [21]-[22] presented a MultiAgent
System (MAS) for generation scheduling of a microgrid. The H. S. V. S. Kumar Nunna et al in [29], proposed a two level
MAS architecture proposed by authors had different types of architecture for distributed energy resource management for
agents such as micro source controller agent, load controller multiple microgrids using multi agent systems (MAS). At the
agent, storage agent, and microgrid controller agent. Micro end authors presented two case studies with two and four
source controller agent that modeled corresponding distributed interconnected microgrids participating in market.
energy sources such as photovoltaic, wind turbine. The
distributed generators, maximized their power production Thillainathan Logenthiran et al in [30], presented a multiagent
subject to production cost and unit's constraints. Load controller system for real-time operation of a residential microgrid in both
agent representing corresponding controllable load in the grid-connected and islanded modes with a RTDS. The
system, was capable to do demand side management techniques. multiagent system was developed in an open source IEEE FIPA
The MAS was successfully developed in JADE,a FIPA compliant platform, and a two-stage operational strategy was
compliant open source multiagent platform. implemented on the multiagent system. The simulations results
from authors demonstrated the effectiveness of the proposed
H. N. Aung et al in [23], developed a Multi Agent System control and management technique, and showed the possibility
(MAS) in JADE platform and implemented the microgrid in of autonomous built-in operation of a microgrid with a
Real Time Digital Simulator (RTDS). The control system multiagent system.
included an algorithm for the management of the microgrid
operation in both grid connected and islanded modes,
functionality of power management, load sharing, isolating 3.3 SERVICE RESTORATION
microgrid and securing critical loads during the power outage. A
real-time communication interface between MAS and RTDS X. D. Li et al in [31], proposed a model based on multi-agent
was presented via TCP/IP. The simulation results of the study immune (MIA) algorithm to solve the service restoration
carried by authors indicated the effectiveness of proposed agent- problem in the event of a large-scale blackout in a power
based control system in coordinating the distributed energy distribution network with DGs. The authors used "random tree"
resources in real-time for operation of both islanded and grid method to code the antibody which avoids lots of unfeasible
connected modes. solutions. The authors manifested the feasibility and high speed
of MIA in DSR problem considering DGs.
C.M. Colson et al in [24], presented a a distributed agent based
microgrid control architecture capable of coordinating and Peng Li et al in [32], build up a multi-agent system (MAS) for
cooperatively achieving user-defined objectives. The authors service restoration of microgrid. The authors also discussed , the
also presented key attributes of centralized versus decentralized special functions and control strategies of each agent in detail.
agent-based control. With the help of simulations the authors demonstrated that the
efficiency and reliability of the microgrid can be improved by
Niannian Cai et al in [25], presented a hierarchical control using MAS.
scheme using a multi-agent system for black start operation of a
microgrid with power electronic interfaces. The authors Yinliang Xu et al in [33], proposed a stable MAS based load
proposed five types of agents, namely Grid Agent, Central restoration algorithm for microgrids based on the Average
Agent, Generation Agent, Load Agent and Breaker Agent. The Consensus Theorem. The proposed algorithm has the
authors showed that with the help of proposed architecture, the advantages such as guaranteed stability of the algorithm ,
multi-agent system is able to coordinate distributed generators generalized nature of the algorithm suitable for power systems of
(DG) and loads to maintain steady state operation of the any configurations and sizes. With the help of simulations the
microgrid either in grid-connected mode or islanded mode; it can authors demonstrated the effectiveness of the proposed
also perform a black start if a seamless transition to the islanded algorithm.
mode fails or if a black start becomes necessary for any other
reason. Seetaram Alwala et in in [34], proposed a Multi Agent System
(MAS) based on sequence current magnitudes and current
Mao Meiqin et al in [26], presented a novel platform for the direction, for fault location and isolation in a smart microgrid
study of EMS-MG based on MAS and used a structure of system. The authors used a hierarchical model in which fault
Client- Server to implement it. With the help of simulations the detection is done at the top level while the fault location is done
authors showed that a generation coordination control method is at the zonal level.. Authors tested the MAS on modified IEEE37
valid in operating the Microgrid in islanding mode or bus system. Different fault types like Single line to ground, Line
gridconnected mode. to Line and Three Phase to ground faults were successfully
located by this agent system.
14
International Journal of Computer Applications (0975 – 8887)
International Conference on Recent Trends in engineering & Technology - 2013(ICRTET'2013)
15
International Journal of Computer Applications (0975 – 8887)
International Conference on Recent Trends in engineering & Technology - 2013(ICRTET'2013)
[5] Stephen D. J. McArthur, Euan M. Davidson, Victoria M. Technologies, ICSET 2008, Hongkong, 24-27 November.
Catterson, Aris L. Dimeas, Nikos D. Hatziargyriou, 2008, pp:77-82
Ferdinanda Ponci, Toshihisa Funabashi, ―Multi-Agent
[18]Zhang Jian, Ai Qian, Jiang Chuanwen, Wang Xingang,
Systems for Power Engineering Applications—Part I:
Concepts, Approaches, and Technical Challenges‖, IEEE Zheng Zhanghua, Gu Chenghong, ―The application of
Transactions On Power Systems,4 November 2007, Vol. Multi Agent System in Microgrid coordination control‖,
22, No. 4, pp: 1743-1752 Proceedings of IEEE International Conference on
Sustainable Power Generation and Supply, SUPERGEN
[6] H. J. Zhou, J. Z. Cao, C. X. Guo, J. Qin, ―The Architecture '09, Nanjing, 6-7 April 2009, pp:1-6
of Intelligent Distribution Network based on MAS-SOA‖,
[19]Wen-Di Zheng, Jin-Ding Cai, ―A Multi-Agent System for
Proceedings of IEEE Power and Energy Society General
Meeting, Minneapolis, MN, 25-29 July 2010, pp:1-6 Distributed Energy Resources Control in
Microgrid‖,Proceedings of IEEE Power and Energy
[7] Rehan Fazal, Jignesh Solanki, Sarika Khushalani Solanki, Society General Meeting, Minneapolis, MN, 25-29 July
―Demand Response using Multi-agent System‖, 2010, pp:1-6
Proceedings of North American Power Symposium (NAPS
[20]Tinghua Li , Zhe Xiao, Ming Huang, Jiang Yu, Jingsong Hu
2012), Champaign, IL, USA, 9-11 September 2012, pp:1-6
,‖ Control System Simulation of Microgrid Based on IP and
[8] Mingzhu Lu ,C. L. Philip Chen, ―The Design of Multi-agent Multi-Agent‖,Proceedings of International Conference on
based Distributed Energy System‖, Proceedings of IEEE Information Networking and Automation (ICINA 2010),
International Conference on Systems, Man and Kunming, 18-19 October 2010, pp: V1-235 - V1-239
Cybernetics, SMC2009, San Antonio, TX, 11-14 October
[21]T. Logenthiran,, D. Srinivasan, A. M. Khambadkone ,H. N.
2009, pp:2001-2006
Aung, ―Multi-Agent System (MAS) for Short-Term
[9] A. Dimeas, N. Hatziargyriou , ―A MultiAgent System for Generation Scheduling of a Microgrid‖ , Proceedings of
Microgrids‖, Proceedings of IEEE PES Power Engineering International Conference on Sustainable Energy
Society General Meeting, 6-10 June 2004, vol-1, pp:55-58 Technologies (ICSET 2010), Kandy, 6-9 December 2010,
pp: 1-6
[10]Aris L. Dimeas, Nikos D. Hatziargyriou , ―Operation of a
Multiagent System for Microgrid Control‖,IEEE [22]T. Logenthiran, D. Srinivasan, A. M. Khambadkone, H. N.
Transactions On Power Systems, August 2005, Vol. 20, Aung, ―Scalable Multi-Agent System (MAS) for Operation
No. 3, pp: 1447-1455 of a Microgrid in Islanded Mode‖, Proceedings of Joint
International Conference on Sustainable Power
[11]A. L. Dimeas, N. D. Hatziargyriou, ―A MAS architecture for
Electronics, Drives and Energy Systems (PEDES) &
Microgrids control‖,Proceedings of the 13th International Power India, New Delhi, 20-23 December 2010. Pp:1-6
Conference on Intelligent Systems Application to Power
Systems, 2005, Arlington, VA, 6-10 November 2005, [23]H. N. Aung, A. M. Khambadkone, D. Srinivasan, T.
pp:402-406 Logenthiran, ―Agent-based Intelligent Control for Real-
time Operation of a Microgrid‖, Proceedings of Joint
[12]A.L. Dimeas , N.D. Hatziargyriou ,‖ Agent based Control for
International Conference on Sustainable Power Electronics,
Microgrids‖, Proceedings of IEEE PES Power Engineering Drives and Energy Systems (PEDES) & Power India, New
Society General Meeting, Tampa, Florida, 24-28 June Delhi, 20-23 December 2010. pp:1-6
2007, pp:1-5
[24]C.M. Colson, M.H. Nehrir, ―Agent-based Power
[13]A. L. Dimeas, N. D. Hatziargyriou, ―Multi-Agent Management of Microgrids including Renewable Energy
Reinforcement Learning for Microgrids‖, Proceedings of Power Generation‖, Proceedings of IEEE Power and
IEEE Power and Energy Society General Meeting, Energy Society General Meeting 2011, San Diego, CA, 24-
Minneapolis, MN, 25-29 July 2010, pp:1-8 29 July 2011, pp:1-3
[14]J. Oyarzabal, J. Jimeno, J. Ruela, A. Engler, C. Hardt,
[25]Niannian Cai, Xufeng Xu, Joydeep Mitra, ―A Hierarchical
―Agent based Micro Grid Management Multi-agent Control Scheme for a Black Start-Capable
System‖,Proceedings of the International Conference on Microgrid‖, Proceedings of IEEE Power and Energy
Future Power Systems , 2005, Amsterdam, 18 November Society General Meeting 2011, San Diego, CA, 24-29 July
2005, pp:1-6 2011, pp:1-7
[15]Zhenhua Jiang, ―Agent-Based Control Framework for
[26]Mao Meiqin, Dong Wei, Liuchen Chang, ―Multi-Agent
Distributed Energy Resources Microgrids‖,Proceedings of Based Simulation for Microgrid Energy Management‖,
the International Conference on Intelligent Agent Proceedinigs of 8th IEEE International Conference on
Technology IAT2006, Hongkong, 18-22 December 2006, Power Electronics and ECCE Asia (ICPE & ECCE
pp: 646-652 2011),Jeju,30 May – 30 June 2011,pp: 1219 - 1223
[16]S. J. Chatzivasiliadis, N. D. Hatziargyriou, A. L. Dimeas,‖
[27]Massimo Cossentino, Carmelo Lodato, Salvatore Lopes,
Development of an Agent Based Intelligent Control System Marcello Pucci, Gianpaolo Vitale, Maurizio Cirrincione, ―A
for Microgrids‖,Proceedings of IEEE Power and Energy Multi-Agent Architecture for Simulating and Managing
Society General Meeting - Conversion and Delivery of Microgrids‖, Proceedings of Federated Conference on
Electrical Energy in the 21st Century, Pittsburgh, PA, 20- Computer Science and Information Systems (FedCSIS
24 July 2008, pp:1-6 2011), Szczecin, Poland, 18-21 September 2011, pp:619-
[17]T. Logenthiran, Dipti Srinivasan, David Wong,‖ Multi- 622
Agent Coordination for DER in MicroGrid‖,Proceedings of [28]A .L. Kulasekera, R.A.R.C. Gopura, K.T.M.U. Hemapala,
IEEE International Conference on Sustainable Energy N.Perera, ―A Review on Multi-Agent Systems in Microgrid
Applications‖,Proceedings of IEEE-PES conference on
16
International Journal of Computer Applications (0975 – 8887)
International Conference on Recent Trends in engineering & Technology - 2013(ICRTET'2013)
Innovative Smart Grid Technologies - India (ISGT India), [37] T. Funabashi, T. Tanabe, T. Nagata, R. Yokoyama, ―An
Kollam, Kerala, 1-3 December 2011, pp: 173-177 Autonomous Agent for Reliable Operation of Power
Market and Systems Including Microgrids‖,
[29]V. S. Kumar Nunna, Suryanarayana Doolla, "Multi Agent
Proceedings of Third International Conference
based Distributed Energy Resource Management for on Electric Utility Deregulation and
Intelligent Microgrids‖,IEEE Transactions on Industrial Restructuring and Power Technologies, 2008,
Electronics, 06 April2012, Vol:PP, Issue:99, pp: 1-10 Nanjuing, China, 6- 9 April 2008, pp: 173-177
[30] Thillainathan Logenthiran, Dipti Srinivasan, Ashwin M. [38] Rui Duan, Geert Deconinck, ―Multi-agent Coordination in
Khambadkone, Htay Nwe Aung, ―Multiagent System for Market Environment for Future Electricity
Real-Time Operation of a Microgrid in Real-Time Infrastructure based on Microgrids‖, Proceedings of IEEE
Digital Simulator‖,IEEE Transactions On International Conference on Systems, Man and
Smartgrid,June 2012, Vol. 3,No.2, pp: 925-933 Cybernetics, SMC2009, San Antonio, TX, 11- 14
[31] X. D. Li, Y. Q.XU, L. Zhang, ―Distribution Service October 2009, pp:3959-3964
Restoration with DGs Based on Multi-agent [39] Rui Duan, Geert Deconinck, ―Multi-agent Model and
Immune Algorithm‖,Proceedings of 31st IEEE Interoperability of a Market Mechanism of the Smart
International Conference on Telecommunications Grids‖, Proceedings of IEEE/PES Symposium
Energy , INTELEC 2009, Incheon, 18-22 October Workshop on Network Operations and
2009, pp:1-5 Management (NOMS Wksps2010), Osaka, 19-23
[32] Peng Li, Tiemin Wang, ―Multi-agent Approach for Service April 2010, pp:312-315
Restoration of Microgrid‖ , Proceedings of 5th [40] A. L. Dimeas, N. D. Hatziargyriou, ―Agent based control of
IEEE conference on Industrial Electronics Virtual Power Plants‖,Proceedings of International
and Applications (ICIEA 2010 ), Taichung, 15-17 June Conference on Intelligent Systems Applications
2010, 962-966 to Power Systems, 2007, Toki Messe, Niigata, 5-8
[33] Yinliang Xu, Wenxin Liu, ―Novel Multiagent Based Load November 2007, pp:1-6
Restoration Algorithm for [41] Isabel Praça, Hugo Morais, Carlos Ramos, Zita Vale,
Microgrids‖, IEEE Transactions On Hussein Khodr, ―Multi-Agent Electricity Market
Smartgrid, March 2011, Vol. 2,No. 1,pp:152-161 Simulation with Dynamic Strategies & Virtual
[34] Seetaram Alwala, Ali Feliachi, M. A. Choudhry, ―Multi Power Producers‖,Proceedings of IEEE
Agent System based Fault Power and Energy Society General Meeting -
Location and Isolation in a Conversion and Delivery of Electrical Energy in
Smart Microgrid System‖, Proceedings of IEEE PES the 21st Century, Pittsburgh, PA, 20-24 July 2008,
conference on Innovative Smart pp:1-8
Grid Technologies (ISGT [42] M. Pipattanasomporn, H. Feroze, S. Rahman,‖ Multi-Agent
2012),Washington, DC, 16-20 January 2012, pp:1-4 Systems in a Distributed Smart Grid: Design and
[35] M. Pipattanasomporn, H. Feroze, S. Rahman, ―Multi-Agent Implementation‖,Proceedings of IEEE/PES Power
Systems in a Distributed Smart Grid: Design and Systems Conference and Exposition, PSCE '09,
Implementation‖,Proceedings of IEEE/PES Power Seattle,WA, 15-18 March 2009, pp:1 – 8
Systems Conference and Exposition, PSCE '09, [43] Niannian Cai, , Nguyen Thi Thanh Nga, Joydeep Mitra,
Seattle,WA, 15-18 March 2009, pp:1 – 8 ―Economic Dispatch in Microgrids, Using Multi-
[36] T S. Logenthiran,Dipti Srinivasan,Tan Zong Shun, ―Multi- Agent System‖, Proceedings of North
Agent System for Demand Side Management in Smart American Power Symposium (NAPS 2012),
Grid‖, Proceedings of 9th IEEE International Champaign, IL, USA, 9-11 September 2012, pp:1-5
Conference on Power Electronics and
DriveSystems (PEDS 2011), Singapore, 5-8 Dec.
2011, pp: 424 - 429
17