论文标题

用于资源约束物联网的差异私人联盟学习

Differentially Private Federated Learning for Resource-Constrained Internet of Things

论文作者

Hu, Rui, Guo, Yuanxiong, Ratazzi, E. Paul., Gong, Yanmin

论文摘要

随着智能设备具有内置传感器,Internet连接性和可编程计算功能的扩散(IoT),网络边缘正在生成巨大的数据。联合学习能够分析来自分布式智能设备集的大量数据,而无需他们将数据上传到中心位置。但是,常用的联合学习算法基于随机梯度下降(SGD),由于其高通信资源的要求,因此不适用于资源受限的物联网环境。此外,敏感数据对智能设备的隐私已成为关键问题,需要严格保护。本文提出了一个名为DP-PASGD的新型联合学习框架,用于从物联网中的资源约束智能设备中存储的数据有效地训练机器学习模型,同时保证差异隐私。 DP-PASGD的最佳示意图,在满足资源成本和隐私损失限制的同时,将最大化的学习绩效最大化,作为优化问题,并且基于DP-PASGD收敛分析的近似解决方案方法有效地解决了优化问题。基于现实世界数据集的数值结果验证了提出的DP-PASGD方案的有效性。

With the proliferation of smart devices having built-in sensors, Internet connectivity, and programmable computation capability in the era of Internet of things (IoT), tremendous data is being generated at the network edge. Federated learning is capable of analyzing the large amount of data from a distributed set of smart devices without requiring them to upload their data to a central place. However, the commonly-used federated learning algorithm is based on stochastic gradient descent (SGD) and not suitable for resource-constrained IoT environments due to its high communication resource requirement. Moreover, the privacy of sensitive data on smart devices has become a key concern and needs to be protected rigorously. This paper proposes a novel federated learning framework called DP-PASGD for training a machine learning model efficiently from the data stored across resource-constrained smart devices in IoT while guaranteeing differential privacy. The optimal schematic design of DP-PASGD that maximizes the learning performance while satisfying the limits on resource cost and privacy loss is formulated as an optimization problem, and an approximate solution method based on the convergence analysis of DP-PASGD is developed to solve the optimization problem efficiently. Numerical results based on real-world datasets verify the effectiveness of the proposed DP-PASGD scheme.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源