GTFLAT, as a game theory-based add-on, addresses an important research question: How can a federated learning algorithm achieve better performance and training efficiency by setting more effective adaptive weights for averaging in the model aggregation phase? The main objectives for the ideal method of answering the question are: (1) empowering federated learning algorithms to reach better performance in fewer communication rounds, notably in the face of heterogeneous scenarios, and last but not least, (2) being easy to use alongside the state-of-the-art federated learning algorithms as a new module. To this end, GTFLAT models the averaging task as a strategic game among active users. Then it proposes a systematic solution based on the population game and evolutionary dynamics to find the equilibrium. In contrast with existing approaches that impose the weights on the participants, GTFLAT concludes a self-enforcement agreement among clients in a way that none of them is motivated to deviate from it individually. The results reveal that, on average, using GTFLAT increases the top-1 test accuracy by 1.38%, while it needs 21.06% fewer communication rounds to reach the accuracy.
翻译:GTFLAT作为一个基于游戏理论的附加工具,处理了一个重要的研究问题:一个联合学习算法如何通过在模型汇总阶段为平均水平设定更有效的适应权重来提高业绩和培训效率? 最理想的回答方法的主要目标是:(1) 授权联合学习算法在较少的交流回合中取得更好的业绩,特别是在面临多种情况的情况下,最后但并非最不重要,(2) 很容易与最先进的联合学习算法作为新模块一起使用。为此,GTFLAT将平均任务模型作为活跃用户之间的战略游戏。然后,它提出基于人口游戏和进化动态的系统解决方案,以找到平衡。 与目前对参与者施加权重的方法相反,GTFLAT在客户之间达成自我执行协议,其方式是没有哪个客户愿意单独偏离它。 结果显示,平均而言,使用GTFLAT将头一号测试精度提高1.38%,同时需要减少21.06%的交流回合以达到准确度。