跳到主要导航 跳到搜索 跳到主要内容

FedPSA: Modeling behavioral staleness in asynchronous federated learning

  • Chaoyi Lu
  • , Yiding Sun
  • , Zhichuan Yang
  • , Jinqian Chen
  • , Dongfu Yin
  • , Jihua Zhu
  • Xi'an Jiaotong University
  • Xidian University
  • Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ)

科研成果: 期刊稿件文章同行评审

摘要

Asynchronous Federated Learning (AFL) has become an important research direction in recent years. By avoiding waiting for slow clients and enabling concurrent training, AFL accelerates training compared with standard federated learning. However, asynchrony inevitably introduces stale updates, which may degrade model performance. Existing methods mostly adopt round difference to quantify staleness, a coarse-grained indicator that ignores intrinsic model characteristics and restricts the overall performance. In this work, we propose FedPSA, a fine-grained asynchronous federated learning framework. Specifically, we measure model obsolescence via parameter sensitivity approximated with second-order Taylor expansion and the empirical Fisher diagonal on a shared calibration batch. We further maintain a dynamic momentum queue to track recent update magnitudes, infer the real-time training stage, and adaptively adjust temperature-controlled aggregation weights. Extensive experiments on MNIST, FMNIST, CIFAR-10, and CIFAR-100 under IID and non-IID settings demonstrate that FedPSA generally outperforms existing methods in terms of final accuracy and convergence, achieving up to 6.37% improvement over baselines and 1.93% over state-of-the-art approaches.

源语言英语
期刊论文编号133003
期刊Expert Systems with Applications
329
DOI
出版状态已出版 - 1 11月 2026
已对外发布

学术指纹

探究 'FedPSA: Modeling behavioral staleness in asynchronous federated learning' 的科研主题。它们共同构成独一无二的学术指纹。

引用此