论文标题

通过无线网络联合学习的收敛时间优化

Convergence Time Optimization for Federated Learning over Wireless Networks

论文作者

Chen, Mingzhe, Poor, H. Vincent, Saad, Walid, Cui, Shuguang

论文摘要

在本文中,研究了联合学习(FL)的收敛时间,当通过现实的无线网络部署时。特别是,考虑了无线网络,无线用户将其本地FL模型(使用其本地收集的数据训练)传输到基站(BS)。 BS充当中央控制器,使用接收到的本地FL模型生成全局FL模型,并将其播放给所有用户。由于无线网络中资源块(RBS)数量有限,因此只能选择一部分用户将其本地FL模型参数传输到每个学习步骤中的BS。此外,由于每个用户都有唯一的培训数据样本,因此BS更喜欢包括所有本地用户FL模型来生成收敛的全局FL模型。因此,FL性能和收敛时间将受到用户选择方案的显着影响。因此,有必要设计一种适当的用户选择方案,以使具有更高重要性的用户可以更频繁地选择。这种联合学习,无线资源分配和用户选择问题被提出为优化问题,其目标是在优化FL性能的同时最大程度地减少FL收敛时间。为了解决此问题,提出了一种概率用户选择方案,以便BS连接到本地FL模型对其具有较高概率的全局FL模型具有重大影响的用户。给定用户选择策略,可以确定上行链路RB分配。为了进一步减少FL收敛时间,使用人工神经网络(ANN)来估计未在每个给定学习步骤中分配任何RB的用户的本地FL模型,这使BS能够增强其全局FL模型并提高FL收敛速度和性能。

In this paper, the convergence time of federated learning (FL), when deployed over a realistic wireless network, is studied. In particular, a wireless network is considered in which wireless users transmit their local FL models (trained using their locally collected data) to a base station (BS). The BS, acting as a central controller, generates a global FL model using the received local FL models and broadcasts it back to all users. Due to the limited number of resource blocks (RBs) in a wireless network, only a subset of users can be selected to transmit their local FL model parameters to the BS at each learning step. Moreover, since each user has unique training data samples, the BS prefers to include all local user FL models to generate a converged global FL model. Hence, the FL performance and convergence time will be significantly affected by the user selection scheme. Therefore, it is necessary to design an appropriate user selection scheme that enables users of higher importance to be selected more frequently. This joint learning, wireless resource allocation, and user selection problem is formulated as an optimization problem whose goal is to minimize the FL convergence time while optimizing the FL performance. To solve this problem, a probabilistic user selection scheme is proposed such that the BS is connected to the users whose local FL models have significant effects on its global FL model with high probabilities. Given the user selection policy, the uplink RB allocation can be determined. To further reduce the FL convergence time, artificial neural networks (ANNs) are used to estimate the local FL models of the users that are not allocated any RBs for local FL model transmission at each given learning step, which enables the BS to enhance its global FL model and improve the FL convergence speed and performance.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源