Master’s Research Paper Presentation • Machine Learning • HERL: Tiered Federated Learning with Adaptive Homomorphic Encryption using Reinforcement Learning

Thursday, December 19, 2024 11:00 am - 12:00 pm EST (GMT -05:00)

Please note: This master’s research paper presentation will take place online.

Zeshan Fayyaz, Master’s candidate
David R. Cheriton School of Computer Science

Supervisor: Professor Raouf Boutaba

Federated Learning is a well-researched approach for collaboratively training machine learning models across decentralized data while preserving privacy. However, integrating Homomorphic Encryption to ensure data confidentiality introduces significant computational and communication overheads, particularly in heterogeneous environments where clients have varying computational capacities and security needs.

In this paper, we propose HERL, a Reinforcement Learning-based approach that uses Q-Learning to dynamically optimize encryption parameters, specifically the polynomial modulus degree, N, and the coefficient modulus, q, across different client tiers. Our proposed method involves first profiling and tiering clients according to the chosen clustering approach, followed by dynamically selecting the most suitable encryption parameters using an RL-agent. Experimental results demonstrate that our approach significantly reduces the computational overhead while maintaining utility and a high level of security. Empirical results show that HERL improves utility by 17%, reduces the convergence time by up to 24%, and increases convergence efficiency by up to 30%, with minimal security loss.


Attend this master’s research paper presentation virtually on Zoom