Papers
arxiv:2205.13341

QUIC-FL: Quick Unbiased Compression for Federated Learning

Published on May 26, 2022
Authors:
,
,
,
,
,

Abstract

Distributed mean estimation techniques are enhanced by reformulating the problem to enable improved quantization through mathematical solvers, achieving better complexity trade-offs for encoding and decoding operations.

AI-generated summary

Distributed Mean Estimation (DME), in which n clients communicate vectors to a parameter server that estimates their average, is a fundamental building block in communication-efficient federated learning. In this paper, we improve on previous DME techniques that achieve the optimal O(1/n) Normalized Mean Squared Error (NMSE) guarantee by asymptotically improving the complexity for either encoding or decoding (or both). To achieve this, we formalize the problem in a novel way that allows us to use off-the-shelf mathematical solvers to design the quantization.

Community

Sign up or log in to comment

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2205.13341 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2205.13341 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2205.13341 in a Space README.md to link it from this page.

Collections including this paper 1