论文标题

多代理深钢筋学习驱动的缓解网络攻击对电动汽车充电站的不利影响

Multi-Agent Deep Reinforcement Learning-Driven Mitigation of Adverse Effects of Cyber-Attacks on Electric Vehicle Charging Station

论文作者

Basnet, M., Ali, MH

论文摘要

电动汽车充电站(EVCS)基础设施是运输电气化的骨干。但是,EVC在软件,硬件,供应链和现有的遗产技术(例如网络,通信和控制)中具有无数可剥削的漏洞。这些独立的或网络的EVC为本地或国家资助的对手开辟了大型攻击表面。最先进的方法不足以防御和减轻先进的持久威胁(APT)。我们提出了基于多基因深度强化学习(MADRL)的无数据驱动的无模型分布式智能 - 双胞胎延迟的深层确定性策略梯度(TD3) - 有效地学习了控制策略,以减轻EVC控制器的网络攻击。此外,我们提出了两种其他缓解方法:手动/蛮力缓解和基于控制器的缓解方法。攻击模型考虑了旨在通过I型低频攻击和II型恒定攻击的EVCS控制器的职责周期的APT。提议的模型通过纠正旧控制器生成的控制信号来恢复任何/所有控制器威胁发生率的操作。同样,与其他两种缓解方法相比,TD3算法通过学习非线性控制策略提供了更高的粒度。索引术语:网络攻击,深度加固学习(DRL),电动汽车充电站,缓解措施。

An electric vehicle charging station (EVCS) infrastructure is the backbone of transportation electrification. However, the EVCS has myriads of exploitable vulnerabilities in software, hardware, supply chain, and incumbent legacy technologies such as network, communication, and control. These standalone or networked EVCS open up large attack surfaces for the local or state-funded adversaries. The state-of-the-art approaches are not agile and intelligent enough to defend against and mitigate advanced persistent threats (APT). We propose the data-driven model-free distributed intelligence based on multiagent Deep Reinforcement Learning (MADRL)-- Twin Delayed Deep Deterministic Policy Gradient (TD3) -- that efficiently learns the control policy to mitigate the cyberattacks on the controllers of EVCS. Also, we have proposed two additional mitigation methods: the manual/Bruteforce mitigation and the controller clone-based mitigation. The attack model considers the APT designed to malfunction the duty cycles of the EVCS controllers with Type-I low-frequency attack and Type-II constant attack. The proposed model restores the EVCS operation under threat incidence in any/all controllers by correcting the control signals generated by the legacy controllers. Also, the TD3 algorithm provides higher granularity by learning nonlinear control policies as compared to the other two mitigation methods. Index Terms: Cyberattack, Deep Reinforcement Learning(DRL), Electric Vehicle Charging Station, Mitigation.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源