论文标题
在住宅智能网格中分布了深入的强化学习,用于智能负载调度
Distributed Deep Reinforcement Learning for Intelligent Load Scheduling in Residential Smart Grids
论文作者
论文摘要
多年来,家庭的功耗一直在不断增长。为了应对这种增长,必须对家庭的消费概况进行智能管理,以便家庭可以节省电费,并且可以减少高峰时间对电网的压力。但是,由于电价和电器的消耗中存在随机性,实施这种方法是具有挑战性的。为了应对这一挑战,我们对家庭采用了一种无模型的方法,该方法与有关不确定因素的有限信息一起使用。更具体地说,家庭与电网之间的相互作用可以建模为一种非合作随机游戏,在该游戏中,电价被视为随机变量。为了搜索游戏的NASH均衡(NE),我们采用了一种基于分布式深度强化学习的方法。此外,提议的方法可以保留家庭的隐私。然后,我们利用Pecan Street Inc.的现实数据,其中包含1个以上的功耗概况; 000户家庭,以评估所提出的方法的性能。平均而言,结果表明,我们可以在峰值与平均比率(PAR)和负载方差减少11%的情况下降低约12%。通过这种方法,可以降低电网的运行成本和家庭的电力成本。
The power consumption of households has been constantly growing over the years. To cope with this growth, intelligent management of the consumption profile of the households is necessary, such that the households can save the electricity bills, and the stress to the power grid during peak hours can be reduced. However, implementing such a method is challenging due to the existence of randomness in the electricity price and the consumption of the appliances. To address this challenge, we employ a model-free method for the households which works with limited information about the uncertain factors. More specifically, the interactions between households and the power grid can be modeled as a non-cooperative stochastic game, where the electricity price is viewed as a stochastic variable. To search for the Nash equilibrium (NE) of the game, we adopt a method based on distributed deep reinforcement learning. Also, the proposed method can preserve the privacy of the households. We then utilize real-world data from Pecan Street Inc., which contains the power consumption profile of more than 1; 000 households, to evaluate the performance of the proposed method. In average, the results reveal that we can achieve around 12% reduction on peak-to-average ratio (PAR) and 11% reduction on load variance. With this approach, the operation cost of the power grid and the electricity cost of the households can be reduced.