Article
Version 1
This version is not peer-reviewed
AWDP-FL: An Adaptive Differential Privacy Federated Learning Framework
Version 1
: Received: 16 August 2024 / Approved: 17 August 2024 / Online: 20 August 2024 (04:59:08 CEST)
How to cite: Chen, Z.; Zheng, H.; Liu, G. AWDP-FL: An Adaptive Differential Privacy Federated Learning Framework. Preprints 2024, 2024081270. https://doi.org/10.20944/preprints202408.1270.v1 Chen, Z.; Zheng, H.; Liu, G. AWDP-FL: An Adaptive Differential Privacy Federated Learning Framework. Preprints 2024, 2024081270. https://doi.org/10.20944/preprints202408.1270.v1
Abstract
Data security and user privacy concerns are increasingly gaining attention. Federated learning models based on differential privacy offer a distributed machine learning framework that protects data privacy; however, the added noise can impact the model's utility, making performance evaluation crucial. To optimize the balance between privacy protection and model performance, we propose the Adaptive Weight-Based Differential Privacy Federated Learning (AWDP-FL) framework. This framework processes model parameters from the perspectives of neural network layers and model weights. Initially, each participant trains the model locally. During iterative training, the clipping threshold is determined by selecting an adaptive weight coefficient, followed by adaptive gradient clipping to control the gradient magnitude. Subsequently, adaptive gradient updates are applied to the model, and dynamic Gaussian noise is introduced when uploading the parameters to protect participant privacy. The server aggregates these noise-perturbed parameters to update the global model. This framework ensures strong privacy protection while maintaining model accuracy. Theoretical analysis and experimental results validate the effectiveness of this framework under stringent privacy constraints.
Keywords
federated learning; differential privacy; adaptive weight clipping; privacy preserving
Subject
Computer Science and Mathematics, Artificial Intelligence and Machine Learning
Copyright: This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Comments (0)
We encourage comments and feedback from a broad range of readers. See criteria for comments and our Diversity statement.
Leave a public commentSend a private comment to the author(s)
* All users must log in before leaving a comment