TY - JOUR
T1 - FedPSA
T2 - Modeling behavioral staleness in asynchronous federated learning
AU - Lu, Chaoyi
AU - Sun, Yiding
AU - Yang, Zhichuan
AU - Chen, Jinqian
AU - Yin, Dongfu
AU - Zhu, Jihua
N1 - Publisher Copyright:
© 2026 Elsevier Ltd. All rights are reserved, including those for text and data mining, AI training, and similar technologies.
PY - 2026/11/1
Y1 - 2026/11/1
N2 - Asynchronous Federated Learning (AFL) has become an important research direction in recent years. By avoiding waiting for slow clients and enabling concurrent training, AFL accelerates training compared with standard federated learning. However, asynchrony inevitably introduces stale updates, which may degrade model performance. Existing methods mostly adopt round difference to quantify staleness, a coarse-grained indicator that ignores intrinsic model characteristics and restricts the overall performance. In this work, we propose FedPSA, a fine-grained asynchronous federated learning framework. Specifically, we measure model obsolescence via parameter sensitivity approximated with second-order Taylor expansion and the empirical Fisher diagonal on a shared calibration batch. We further maintain a dynamic momentum queue to track recent update magnitudes, infer the real-time training stage, and adaptively adjust temperature-controlled aggregation weights. Extensive experiments on MNIST, FMNIST, CIFAR-10, and CIFAR-100 under IID and non-IID settings demonstrate that FedPSA generally outperforms existing methods in terms of final accuracy and convergence, achieving up to 6.37% improvement over baselines and 1.93% over state-of-the-art approaches.
AB - Asynchronous Federated Learning (AFL) has become an important research direction in recent years. By avoiding waiting for slow clients and enabling concurrent training, AFL accelerates training compared with standard federated learning. However, asynchrony inevitably introduces stale updates, which may degrade model performance. Existing methods mostly adopt round difference to quantify staleness, a coarse-grained indicator that ignores intrinsic model characteristics and restricts the overall performance. In this work, we propose FedPSA, a fine-grained asynchronous federated learning framework. Specifically, we measure model obsolescence via parameter sensitivity approximated with second-order Taylor expansion and the empirical Fisher diagonal on a shared calibration batch. We further maintain a dynamic momentum queue to track recent update magnitudes, infer the real-time training stage, and adaptively adjust temperature-controlled aggregation weights. Extensive experiments on MNIST, FMNIST, CIFAR-10, and CIFAR-100 under IID and non-IID settings demonstrate that FedPSA generally outperforms existing methods in terms of final accuracy and convergence, achieving up to 6.37% improvement over baselines and 1.93% over state-of-the-art approaches.
KW - Asynchronous federated learning
KW - Federated learning
KW - Parameter sensitivity
KW - Staleness modeling
UR - https://www.scopus.com/pages/publications/105040754493
U2 - 10.1016/j.eswa.2026.133003
DO - 10.1016/j.eswa.2026.133003
M3 - 文章
AN - SCOPUS:105040754493
SN - 0957-4174
VL - 329
JO - Expert Systems with Applications
JF - Expert Systems with Applications
M1 - 133003
ER -