We lifted 12 functions out of this paper's own repositories and ran 7 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.
| Repository | Role | Ran |
|---|---|---|
| onizukalab/fedbench | canonical | 7 of 12 |
| Function | Status | Where it lives |
|---|---|---|
| line_to_indices | Ran | onizukalab/fedbench/code/utils/utils_sent140.py code served (permissive licence) · get_code("944fedd1c33c8b12") |
| make_layers | Ran | onizukalab/fedbench/code/utils/model.py code served (permissive licence) · get_code("a88e5716356279d0") |
| matched_vgg11 | Ran | onizukalab/fedbench/code/utils/model.py code served (permissive licence) · get_code("9691ea80c30c06e8") |
| process_x | Ran | onizukalab/fedbench/code/utils/utils_sent140.py code served (permissive licence) · get_code("340f2a473b8267d5") |
| process_y | Ran | onizukalab/fedbench/code/utils/utils_sent140.py code served (permissive licence) · get_code("0c81285c78db2513") |
| read_data | Ran | onizukalab/fedbench/code/utils/sent140_dataset.py code served (permissive licence) · get_code("113b54f5013bd868") |
| vgg11_bn | Ran | onizukalab/fedbench/code/utils/model.py code served (permissive licence) · get_code("f7cd4a2b57319df7") |
| get_dataset | Not yet run | onizukalab/fedbench/code/utils/cifar10_dataset.py code served (permissive licence) · get_code("46db664ebd350aa3") |
| get_dataset | Not yet run | onizukalab/fedbench/code/utils/femnist_dataset.py code served (permissive licence) · get_code("02e3e53196e5871e") |
| get_dataset | Not yet run | onizukalab/fedbench/code/utils/mnist_dataset.py code served (permissive licence) · get_code("e34e4f12bbf9cb40") |
| get_dataset | Not yet run | onizukalab/fedbench/code/utils/sent140_dataset.py code served (permissive licence) · get_code("3f9fb06d152c383a") |
| get_dataset | Not yet run | onizukalab/fedbench/code/utils/shakespeare_dataset.py code served (permissive licence) · get_code("ad7ba8392208f3dd") |
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Federated learning is a distributed machine learning approach in which a single server and multiple clients collaboratively build machine learning models without sharing datasets on clients. A challenging issue of federated learning is data heterogeneity (i.e., data distributions may differ across clients). To cope with this issue, numerous federated learning methods aim at personalized federated learning and build optimized models for clients. Whereas existing studies empirically evaluated their own methods, the experimental settings (e.g., comparison methods, datasets, and client setting) in these studies differ from each other, and it is unclear which personalized federate learning method achieves the best performance and how much progress can be made by using these methods instead of standard (i.e., non-personalized) federated learning. In this paper, we benchmark the performance of existing personalized federated learning through comprehensive experiments to evaluate the characteristics of each method. Our experimental study shows that (1) there are no champion methods, (2) large data heterogeneity often leads to high accurate predictions, and (3) standard federated learning methods (e.g. FedAvg) with fine-tuning often outperform personalized federated learning methods. We open our benchmark tool FedBench for researchers to conduct experimental studies with various experimental settings.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2206.13190")
get_code_for_paper("2206.13190")
have("2206.13190")
Connect an agent — have() is free.