SplitFed: When Federated Learning Meets Split Learning

SplitFed: когда федеративное обучение встречается с разделённым обучением
Lichao Sun, Seyit Ahmet Camtepe, Chandra Thapa, Pathum Chamikara Mahawaga Arachchige
2022-06-28

PixelDPSplitFed learningdifferential privacyfederated learningsplit learning
Federated learning (FL) and split learning (SL) are two popular distributed machine learning approaches. Both follow a model-to-data scenario; clients train and test machine learning models without sharing raw data. SL provides better model privacy than FL due to the machine learning model architecture split between clients and the server. Moreover, the split model makes SL a better option for resource-constrained environments. However, SL performs slower than FL due to the relay-based training across multiple clients. In this regard, this paper presents a novel approach, named splitfed learning (SFL), that amalgamates the two approaches eliminating their inherent drawbacks, along with a refined architectural configuration incorporating differential privacy and PixelDP to enhance data privacy and model robustness. Our analysis and empirical results demonstrate that (pure) SFL provides similar test accuracy and communication efficiency as SL while significantly decreasing its computation time per global epoch than in SL for multiple clients. Furthermore, as in SL, its communication efficiency over FL improves with the number of clients. Besides, the performance of SFL with privacy and robustness measures is further evaluated under extended experimental settings.
1
Like split learning, SFL’s communication efficiency relative to federated learning improves as the number of clients increases.
2
Pure SFL achieves test accuracy and communication efficiency similar to split learning while significantly reducing computation time per global epoch across multiple clients.
3
SplitFed learning (SFL) amalgamates federated learning and split learning to address SL’s slower training and FL’s weaker model privacy.
4
The proposed architecture incorporates differential privacy and PixelDP to strengthen data privacy and model robustness, with performance evaluated under extended experimental settings.

splitfed learning (SFL), a distributed machine learning approach combining federated learning and split learning

SFL’s test accuracy, communication efficiency, computation time per global epoch, privacy, and robustness compared with federated and split learning

Publication Details
Publication Date
2022-06-28
Journal
Publisher
ISSN
Cited by
1141
Access Type
Author Information
Authors
Lichao Sun
Seyit Ahmet Camtepe
Chandra Thapa
Pathum Chamikara Mahawaga Arachchige
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat →
Make a presentation
100%