Research on stochastic game and optimization in complex microgrid control

Hong ZHOU; Ruotian YAO; Chang YU; Zhongcheng LEI

doi:10.11959/j.issn.2096-6652.202027

您当前的位置：

首页 >

文章列表页 >

Research on stochastic game and optimization in complex microgrid control

Regular Papers | 更新时间：2024-06-05

- Research on stochastic game and optimization in complex microgrid control
- Chinese Journal of Intelligent Science and Technology Vol. 2, Issue 3, Pages: 251-260(2020)
- 作者机构：
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.2096-6652.202027
  CLC： TM732
- Published Online：2020-09，
  
  Published：20 September 2020
- 稿件说明：
移动端阅览
Hong ZHOU, Ruotian YAO, Chang YU, et al. Research on stochastic game and optimization in complex microgrid control[J]. Chinese journal of intelligent science and technology, 2020, 2(3): 251-260.
DOI：

Hong ZHOU, Ruotian YAO, Chang YU, et al. Research on stochastic game and optimization in complex microgrid control[J]. Chinese journal of intelligent science and technology, 2020, 2(3): 251-260. DOI： 10.11959/j.issn.2096-6652.202027.

摘要

由大量分布式能源、储能设备以及动态负荷集成的复杂微电网，具有出力-负荷双随机特性。旨在结合随机博弈优化理论，讨论综合能源微电网中的各种决策和优化控制问题。首先，分析了未来复杂微电网的特点和体系结构；其次，重点阐述了综合能源微电网中多种决策群体的博弈形式和交互方式；然后，基于微电网不同的拓扑结构和群体的随机特性，归纳了影响网络博弈的主要因素；最后，给出一种随机博弈优化策略及其控制方法架构。通过深入探讨不同形式下的微电网同步、稳定性及博弈优化等关键问题，为进一步促进清洁能源消纳和供需互动、维护电网稳定提供了新的思路。

Abstract

A microgrid which integrated by a large scale of distributed generators

storage equipment and dynamic loads has stochastic characteristics in both the power generation and the demand-side.The purpose was to discuss various decision-making and optimal control approaches in the integrated energy microgrid based on a stochastic game.Firstly

the characteristic and architecture of the future complex microgrid were investigated.Secondly

the form and interact of the group game were explained in details

respectively.Then

the stochastic characteristics of different players and the topology that affecting the game on complex microgrids were presented.Finally

a stochastic game optimization approach and its control architecture was proposed.By discussing the key issues of microgrid synchronization

stability and game optimization in different perspectives

the new ideas for promoting clean energy consumption

supply-demand side interaction and maintaining the stability of power grids were provided.

关键词

Keywords

references

PAGAN N , DÖRFLER F . Game theoretical inference of human behavior in social networks [J ] . Nature Communications , 2019 , 10 ( 1 ): 5507 - 5512 .

ESFAHANI M M , HARIRI A , MOHAMMED O A . A multiagent-based game-theoretic and optimization approach for market operation of multimicrogrid systems [J ] . IEEE Transactions on Industrial Informatics , 2019 , 15 ( 1 ): 280 - 292 .

李昊飞 , 余涛 , 瞿凯平 , 等 . 综合负荷聚合商参与的配电-气能源系统供需互动均衡模型 [J ] . 电力系统自动化 , 2019 , 43 ( 19 ): 32 - 45 .

LI H F , YU T , QU K P , et al . Equilibrium model of supply and demand interaction in distribution-gas energy system with the participation of comprehensive load aggregator [J ] . Automation of Electric Power Systems , 2019 , 43 ( 19 ): 32 - 45 .

MAHARJAN S , ZHU Q , ZHANG Y , et al . Dependable demand response management in the smart grid:a stackelberg game approach [J ] . IEEE Transactions on Smart Grid , 2013 , 4 ( 1 ): 120 - 132 .

李力行 , 苗世洪 , 余璟 , 等 . 源荷双侧不确定因素影响下基于Rubinstein 博弈的电网双层定价模型 [J ] . 电工技术学报 , 2019 , 34 ( S2 ): 729 - 741 .

LI L X , MIAO S H , YU J , et al . A two-layer pricing model for power grid based on Rubinstein game under the influence of bilateral uncertainties of source load [J ] . Transactions of China Electrotechnical Society , 2019 , 34 ( S2 ): 729 - 741 .

黄南天 , 包佳瑞琦 , 蔡国伟 , 等 . 多主体联合投资微电网源-储多策略有限理性决策演化博弈容量规划 [J ] . 中国电机工程学报 , 2020 , 40 ( 4 ): 1212 - 1225 .

HUANG N T , BAO J R Q , CAI G W , et al . Game capacity planning for the evolution of rational decision making for multi-agent joint investment in microgrid sources-storage-many strategy [J ] . Proceedings of the Chinese Society for Electrical Engineering , 2020 , 40 ( 4 ): 1212 - 1225 .

杨楠 , 黄禹 , 董邦天 , 等 . 基于多主体博弈的电力-天然气综合能源系统联合规划方法研究 [J ] . 中国电机工程学报 , 2019 , 39 ( 22 ): 6521 - 6532 .

YANG N , HUANG Y , DONG B T , et al . Research on joint planning method of electricity-natural gas integrated energy system based on multi-agent game [J ] . Proceedings of the Chinese Society for Electrical Engineering , 2019 , 39 ( 22 ): 6521 - 6532 .

李宏仲 , 王磊 , 林冬 , 等 . 多主体参与可再生能源消纳的Nash博弈模型及其迁移强化学习求解 [J ] . 中国电机工程学报 , 2019 , 39 ( 14 ): 4135 - 4150 .

LI H Z , WANG L , LIN D , et al . Nash game model of multi-subject participation in renewable energy consumption and its solution of transfer reinforcement learning [J ] . Proceedings of the Chinese Society for Electrical Engineering , 2019 , 39 ( 14 ): 4135 - 4150 .

WU X H , HU X S , YIN X F , et al . Stochastic optimal energy management of smart home with PEV energy storage [J ] . IEEE Transactions on Smart Grid , 2018 , 9 ( 3 ): 2065 - 2075 .

李咸善 , 陈敏睿 , 程杉 , 等 . 基于双重激励协同博弈的含电动汽车微电网优化调度策略 [J ] . 高电压技术 , 2020 : 1 - 11 .

LI X S , CHEN M R , CHENG S , et al . Optimal scheduling strategy of electric vehicle microgrid based on double excitation cooperative game [J ] . High Voltage Engineering , 2020 : 1 - 11 .

陈思远 , 白昱阳 , 张俊 , 等 . 基于区块链和通证经济的跨国跨洲电力市场机制设计 [J ] . 智能科学与技术学报 , 2019 , 1 ( 1 ): 96 - 105 .

CHEN S Y , BAI Y Y , ZHANG J , et al . Design of transnational and trans-continental power market mechanism based on block chain and communication economy [J ] . Chinese Journal of Intelligent Science and Technology , 2019 , 1 ( 1 ): 96 - 105 .

ALLAHVIRDIZADEH Y , MOGHADDAM M P , SHAYANFAR H . A survey on cloud computing in energy management of the smart grids [J ] . International Transactions on Electrical Energy Systems , 2019 , 29 ( 10 ):e12094.

王侨侨 , 曾君 , 刘俊峰 , 等 . 面向微电网源-储-荷互动的分布式多目标优化算法研究 [J ] . 中国电机工程学报 , 2020 , 40 ( 5 ): 1421 - 1432 .

WANG Q Q , ZENG J , LIU J F , et al . Research on distributed multi-objective optimization algorithm for source-storage-load interaction in micro power grid [J ] . Proceedings of the Chinese Society for Electrical Engineering , 2020 , 40 ( 5 ): 1421 - 1432 .

DELABAYS R , JACQUOD P , DÖRFLER F . The kuramoto model on oriented and signed graphs [J ] . SIAM Journal on Applied Dynamical Systems , 2019 , 18 ( 1 ): 458 - 480 .

TUSHAR W , YUEN C , MOHSENIAN-RAD H , et al . Transforming energy networks via peer-to-peer energy trading:the potential of game-theoretic approaches [J ] . IEEE Signal Processing Magazine , 2018 , 35 ( 4 ): 90 - 111 .

STEVANONI C , DE GREVE Z , VALLEE F , et al . Long-term planning of connected industrial microgrids:a game theoretical approach including daily peer-to-microgrid exchanges [J ] . IEEE Transactions on Smart Grid , 2019 , 10 ( 2 ): 2245 - 2256 .

TUSHAR W , SAHA T K , YUEN C , et al . A motivational game-theoretic approach for peer-to-peer energy trading in the smart grid [J ] . Applied Energy , 2019 , 243 : 10 - 20 .

YU M M , HONG S H . A real-time demand-response algorithm for smart grids:a stackelberg game approach [J ] . IEEE Transactions on Smart Grid , 2016 , 7 ( 2 ): 879 - 888 .

LIANG H , TAMANG A K , ZHUANG W H , et al . Stochastic information management in smart grid [J ] . IEEE Communications Surveys ＆Tutorials , 2014 , 16 ( 3 ): 1746 - 1770 .

JADHAV A M , PATNE N R , GUERRERO J M . A novel approach to neighborhood fair energy trading in a distribution network of multiple microgrid clusters [J ] . IEEE Transactions on Industrial Electronics , 2019 , 66 ( 2 ): 1520 - 1531 .

WANG Y P , SAAD W , HAN Z , et al . A game-theoretic approach to energy trading in the smart grid [J ] . IEEE Transactions on Smart Grid , 2014 , 5 ( 3 ): 1439 - 1450 .

ZHAO B , XUE M D , ZHANG X S , et al . An MAS based energy management system for a stand-alone microgrid at high altitude [J ] . Applied Energy , 2015 , 143 : 251 - 261 .

KHAN M R B , JIDIN R , PASUPULETI J . Multi-agent based distributed control architecture for microgrid energy management and optimization [J ] . Energy Conversion ＆ Management , 2016 , 112 : 288 - 307 .

CHEN Y , MEI S W , ZHOU F Y , et al . An energy sharing game with generalized demand bidding:model and properties [J ] . IEEE Transactions on Smart Grid , 2019 , 11 ( 3 ): 2055 - 2066 .

KYRIAKARAKOS G , PIROMALIS D D , DOUNIS A I , et al . Intelligent demand side energy management system for autonomous polygeneration microgrids [J ] . Applied Energy , 2013 , 103 : 39 - 51 .

LIU N , CHENG M Y , YU X H , et al . Energy-sharing provider for PV prosumer clusters:a hybrid approach using stochastic programming and stackelberg game [J ] . IEEE Transactions on Industrial Electronics , 2018 , 65 ( 8 ): 6740 - 6750 .

AOLARITEI L , BOLOGNANI S , DORFLER F . Hierarchical and distributed monitoring of voltage stability in distribution networks [J ] . IEEE Transactions on Power Systems , 2018 , 33 ( 6 ): 6705 - 6714 .

MOLZAHN D K , DORFLER F , SANDBERG H , et al . A survey of distributed optimization and control algorithms for electric power systems [J ] . IEEE Transactions on Smart Grid , 2017 , 8 ( 6 ): 2941 - 2962 .

窦迅 , 王俊 , 王湘艳 , 等 . 基于演化博弈的区域电-气互联综合能源系统用户需求侧响应行为分析 [J ] . 中国电机工程学报 , 2019 : 1 - 11 .

DOU X , WANG J , WANG X Y , et al . User demand side response behavior analysis of regional power-gas interconnection integrated energy system based on evolutionary game [J ] . Proceedings of the Chinese Society for Electrical Engineering , 2019 : 1 - 11 .

王飞跃 , 张军 , 张俊 , 等 . 工业智联网:基本概念、关键技术与核心应用 [J ] . 自动化学报 , 2018 , 44 ( 9 ): 1606 - 1617 .

WANG F Y , ZHANG J , ZHANG J , et al . Industrial intelligent networking:basic concepts,key technologies and core applications [J ] . Acta Automatica Sinica , 2008 , 44 ( 9 ): 1606 - 1617 .

KHALILI T , NOJAVAN S , ZARE K . Optimal performance of microgrid in the presence of demand response exchange:a stochastic multi-objective model [J ] . Computers and Electrical Engineering , 2019 , 74 : 429 - 450 .

FOROUZANDEHMEHR N , HAN Z , ZHENG R . Stochastic dynamic game between hydropower plant and thermal power plant in smart grid networks [J ] . IEEE Systems Journal , 2016 : 1 - 9 .

ZENG J , WANG Q Q , LIU J F , et al . A potential game approach to distributed operational optimization for microgrid energy management with renewable energy and demand response [J ] . IEEE Transactions on Industrial Electronics , 2019 , 66 ( 6 ): 4479 - 4489 .

DORFLER F , SIMPSON-PORCO J W , BULLO F . Electrical networks and algebraic graph theory:models,properties,and applications [J ] . Proceedings of the IEEE , 2018 , 106 ( 5 ): 977 - 1005 .

WEISS G , DÖRFLER F , LEVRON Y . A stability theorem for networks containing synchronous generators [J ] . Systems ＆ Control Letters , 2019 , 134 :104561.

NEUMANN J V , MORGENSTERN O . The theory of games and economic behaviour [M ] . Princeton : Princeton University PressPress , 1944 .

NASH J F . Equilibrium points in n-person games [J ] . Proceedings of the National Academy of Sciences of the United States of America , 1950 , 36 ( 1 ): 48 - 49 .

RAJASEKHAR B , PINDORIYA N , TUSHAR W , et al . Collaborative energy management for a residential community:a non-cooperative and evolutionary approach [J ] . IEEE Transactions on Emerging Topics in Computational Intelligence , 2019 , 3 ( 3 ): 177 - 192 .

AGHAJANI S , KALANTAR M . A cooperative game theoretic analysis of electric vehicles parking lot in smart grid [J ] . Energy , 2017 , 137 : 129 - 139 .

MEI J , CHEN C , WANG J H , et al . Coalitional game theory based local power exchange algorithm for networked microgrids [J ] . Applied Energy , 2019 , 239 : 133 - 141 .

LIU Y , DENG R L , LIANG H . A stochastic game approach for PEV charging station operation in smart grid [J ] . IEEE Transactions on Industrial Informatics , 2018 , 14 ( 3 ): 969 - 979 .

TUSHAR W , ZHANG J A , SMITH D B , et al . Prioritizing consumers in smart grid:a game theoretic approach [J ] . IEEE Transactions on Smart Grid , 2013 , 5 ( 3 ): 1429 - 1438 .

YU M M , HONG S H . Supply-demand balancing for power management in smart grid:a stackelberg game approach [J ] . Applied Energy , 2016 , 164 : 702 - 710 .

苏奇 . 复杂网络上的合作演化和博弈动力学研究 [D ] . 北京:北京大学 , 2020 .

SU Q . Research on cooperative evolution and game dynamics in complex networks [D ] . Beijing:Peking University , 2020 .

ERDŐS P , RÉNYI A . On random graphs I [J ] . Publicationes Mathematicae , 1959 , 4 : 3286 - 3291 .

WATTS D J , STROGATZ S H . Collective dynamics of small world networks [J ] . Nature , 1998 , 393 ( 6684 ): 440 - 442 .

BARABÁSI A L , ALBERT R . Emergence of scaling in random networks [J ] . Science , 1999 , 286 ( 5439 ): 509 - 512 .

LATORA V , NICOSIA V , RUSSO G . Complex networks:principles,methods and applications [M ] . Cambridge : Cambridge University PressPress , 2017 .

DORFLER , BULLO . Topological equivalence of a structure-preserving power network model and a non-uniform Kuramoto model of coupled oscillators [C ] // Decision ＆ Control ＆ European Control Conference . Piscataway:IEEE Press , 2011 .

SIMPSON-PORCO J W , DORFLER F , BULLO F . Droop-controlled inverters are kuramoto oscillators [J ] . IFAC Proceedings Volumes , 2012 , 45 ( 26 ): 264 - 269 .

VACCARO A , LOIA V , FORMATO G , et al . A self-organizing architecture for decentralized smart microgrids synchronization,control,and monitoring [J ] . IEEE Transactions on Industrial Informatics , 2015 , 11 ( 1 ): 289 - 298 .

SEN S , KUMAR V . Microgrid control:a comprehensive survey [J ] . Annual Reviews in Control , 2018 , 45 : 118 - 151 .

SOLIMAN H M , LEON-GARCIA A . Game-theoretic demand-side management with storage devices for the future smart grid [J ] . IEEE Transactions on Smart Grid , 2014 , 5 ( 3 ): 1475 - 1485 .

XI L , LI Y D , HUANG Y H , et al . A novel automatic generation control method based on the ecological population cooperative control for the islanded smart grid [J ] . Complexity , 2018 , 2018 : 1 - 17 .

DORFLER F , SIMPSON-PORCO J W , BULLO F . Breaking the hierarchy:distributed control and economic optimality in microgrids [J ] . IEEE Transactions on Control of Network Systems , 2016 , 3 ( 3 ): 241 - 253 .

ZHU X W , XIA M C , CHIANG H D , et al . Coordinated sectional droop charging control for EV aggregator enhancing frequency stability of microgrid with high penetration of renewable energy sources [J ] . Applied Energy , 2018 , 210 : 936 - 943 .

WANG H W , HUANG T W , LIAO X F , et al . Reinforcement learning in energy trading game among smart microgrids [J ] . IEEE Transactions on Industrial Electronics , 2016 , 63 ( 8 ): 5109 - 5119 .

刘可真 , 王骞 , 赵明 , 等 . 基于多方合作博弈及梯级化的电能替代效益分析 [J ] . 电网技术 , 2020 , 44 ( 2 ): 711 - 718 .

LIU K Z , WANG Q , ZHAO M , et al . Analysis of electric energy substitution benefits based on multi-party cooperative game and cascade [J ] . Power System Technology , 2020 , 44 ( 2 ): 711 - 718 .

FOROUZANDEHMEHR N , ESMALIFALAK M , MOHSENIAN-RAD H , et al . Autonomous demand response using stochastic differential games [J ] . IEEE Transactions on Smart Grid , 2015 , 6 ( 1 ): 291 - 300 .

李至骜 , 陈来军 , 刘当武 , 等 . 基于主从博弈的储能电站容量电费定价方法 [J ] . 高电压技术 , 2020 , 46 ( 2 ): 519 - 526 .

LI Z A , CHEN L J , LIU D W , et al . The pricing method of electricity charge for energy storage power station capacity based on master-slave game [J ] . High Voltage Engineering , 2020 , 46 ( 2 ): 519 - 526 .

MONDAL A , MISRA S . Game-theoretic green electric vehicle energy networks management in smart grid [C ] // IEEE International Conference on Advanced Networks ＆ Telecommunications Systems . Piscataway:IEEE Press , 2016 .

BAHRAMI S , WONG V W S , HUANG J W . An online learning algorithm for demand response in smart grid [J ] . IEEE Transactions on Smart Grid , 2017 :1.

KAUR K , SINGH M , KUMAR N . Multi objective optimization for frequency support using electric vehicles:an aggregator-based hierarchical control mechanism [J ] . IEEE Systems Journal , 2017 : 1 - 12 .

李志伟 , 赵书强 , 刘应梅 . 电动汽车分布式储能控制策略及应用 [J ] . 电网技术 , 2016 , 40 ( 2 ): 116 - 124 .

LI Z W , ZHAO S Q , LIU Y M . Distributed energy storage control strategy and application of electric vehicles [J ] . Power System Technology , 2016 , 40 ( 2 ): 116 - 124 .

Views

268

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Overview on game reinforcement learning methods for edge computing of low-orbit constellation

Game patrol strategy for hazardous gas leakage in chemical parks

Brain network evolution modeling based on Alzheimer’s disease

Related Author

GU Xueqiang

ZHANG Wanpeng

TAN Siyu

LUO Junren

ZHOU Yanzhong

Yin CHEN

Lize ZHANG

Guohua SHUAI

Related Institution

College of Intelligence Science and Technology, National University of Defense Technology

Hunan Institute of Advanced Technology

China Telecom Corporation Limited, Guangxi Branch

School of Cyberspace, Hangzhou Dianzi University

ZhuoYue Honors College, Hangzhou Dianzi University

Postal code：100079
Tel：（010）53879206 Email：cjist@bjxintong.com.cn
Technical support is provided by Beijing Founder electronics co., LTD 京ICP备09064830号-19 京公网安备11010802024621
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.
Total Visits：35685 Visits Today：160

⁰