{"id":13568090,"url":"https://github.com/APPFL/APPFL","last_synced_at":"2025-04-04T04:30:47.665Z","repository":{"id":38075868,"uuid":"414722606","full_name":"APPFL/APPFL","owner":"APPFL","description":"Advanced Privacy-Preserving Federated Learning framework","archived":false,"fork":false,"pushed_at":"2025-02-23T22:52:57.000Z","size":68709,"stargazers_count":105,"open_issues_count":12,"forks_count":21,"subscribers_count":6,"default_branch":"main","last_synced_at":"2025-02-24T07:24:26.421Z","etag":null,"topics":["federated-learning-framework","privacy-preserving-machine-learning"],"latest_commit_sha":null,"homepage":"https://appfl.ai","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/APPFL.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":".github/CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":"CITATION.cff","codeowners":null,"security":".github/SECURITY.md","support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-10-07T18:55:33.000Z","updated_at":"2025-02-21T15:36:38.000Z","dependencies_parsed_at":"2023-02-10T16:16:06.809Z","dependency_job_id":"b4f39a3f-ad6e-41e5-809b-7173217e55cb","html_url":"https://github.com/APPFL/APPFL","commit_stats":{"total_commits":518,"total_committers":11,"mean_commits":47.09090909090909,"dds":"0.39768339768339767","last_synced_commit":"1cdea4894e3e013790afd4299034eb35d6bd8b4b"},"previous_names":[],"tags_count":24,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/APPFL%2FAPPFL","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/APPFL%2FAPPFL/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/APPFL%2FAPPFL/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/APPFL%2FAPPFL/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/APPFL","download_url":"https://codeload.github.com/APPFL/APPFL/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247086025,"owners_count":20881160,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["federated-learning-framework","privacy-preserving-machine-learning"],"created_at":"2024-08-01T14:00:19.880Z","updated_at":"2025-04-04T04:30:42.655Z","avatar_url":"https://github.com/APPFL.png","language":"Python","funding_links":[],"categories":["Privacy-Preserving Federated Learning","Python","federated learning framework"],"sub_categories":["Open-Source Tools","table"],"readme":"\u003cp align=\"center\"\u003e\n  \u003ca href=\"http://appfl.rtfd.io\"\u003e\u003cimg src=\"https://github.com/APPFL/APPFL/blob/main/docs/_static/logo/logo_small.png?raw=true\" alt=\"APPFL logo\" style=\"width: 40%; height: auto;\"\u003e\u003c/a\u003e\n\u003c/p\u003e\n\n\u003cp align=\"center\" style=\"font-size: 18px;\"\u003e\n    \u003cb\u003eAPPFL - Advanced Privacy-Preserving Federated Learning Framework\u003c/b\u003e.\n\u003c/p\u003e\n\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://discord.com/invite/bBW56EYGUS\"\u003e\n      \u003cimg src=\"https://dcbadge.vercel.app/api/server/bBW56EYGUS?theme=default-inverted\u0026style=flat\" alt=\"discord\"\u003e\n  \u003c/a\u003e\n  \u003ca href=\"https://zenodo.org/badge/latestdoi/414722606\" target=\"_blank\"\u003e\n      \u003cimg src=\"https://zenodo.org/badge/414722606.svg\" alt=\"DOI\"\u003e\n  \u003c/a\u003e \n  \u003ca href=\"https://appfl.readthedocs.io/en/latest/?badge=latest\" target=\"_blank\"\u003e\n      \u003cimg src=\"https://readthedocs.org/projects/appfl/badge/?version=latest\" alt=\"Doc\"\u003e\n  \u003c/a\u003e\n  \u003ca href=\"https://github.com/APPFL/APPFL/actions/workflows/build.yml\" target=\"_blank\"\u003e\n      \u003cimg src=\"https://github.com/APPFL/APPFL/actions/workflows/build.yml/badge.svg?branch=main\u0026event=push\" alt=\"Build\"\u003e\n  \u003c/a\u003e\n  \u003ca href=\"https://arxiv.org/abs/2202.03672\"\u003e\n      \u003cimg src=\"https://img.shields.io/badge/arXiv-2202.03672-B31B1B.svg\" alt=\"APPFL\"\u003e\n  \u003c/a\u003e\n  \u003ca href=\"https://arxiv.org/abs/2308.08786\"\u003e\n      \u003cimg src=\"https://img.shields.io/badge/arXiv-2308.08786-B31B1B.svg\" alt=\"APPFLx\"\u003e\n  \u003c/a\u003e\n\u003c/p\u003e\n\nAPPFL, Advanced Privacy-Preserving Federated Learning, is an open-source and highly extensible software framework that allows research communities to implement, test, and validate various ideas related to privacy-preserving federated learning (FL), and deploy real FL experiments easily and safely among distributed clients to train more robust ML models.With this framework, developers and users can easily\n\n* Train any user-defined machine learning model on decentralized data with optional differential privacy and client authentication.\n* Simulate various synchronous and asynchronous PPFL algorihtms on high-performance computing (HPC) architecture with MPI.\n* Implement customizations in a plug-and-play manner for all aspects of FL, including aggregation algorithms, server scheduling strategies, and client local trainers.\n\n[Documentation](http://appfl.rtfd.io/): please check out our documentation for tutorials, users guide, and developers guide.\n\n## Table of Contents\n\n* [Installation](#hammer_and_wrench-installation)\n* [Technical Components](#bricks-technical-components)\n* [Framework Overview](#bulb-framework-overview)\n* [Citation](#page_facing_up-citation)\n* [Acknowledgements](#trophy-acknowledgements)\n\n## :hammer_and_wrench: Installation\n\nWe highly recommend creating a new Conda virtual environment and install the required packages for APPFL.\n\n```bash\nconda create -n appfl python=3.8\nconda activate appfl\n```\n\n### User installation\n\nFor most users such as data scientists, this simple installation must be sufficient for running the package.\n\n```bash\npip install pip --upgrade\npip install \"appfl[examples]\"\n```\n\nIf we want to even minimize the installation of package dependencies, we can skip the installation of a few pacakges (e.g., `matplotlib` and `jupyter`):\n\n```bash\npip install \"appfl\"\n```\n\n### Developer installation\n\nCode developers and contributors may want to work on the local repositofy. \nTo set up the development environment, \n\n```bash\ngit clone --single-branch --branch main https://github.com/APPFL/APPFL.git\ncd APPFL\npip install -e \".[dev,examples]\"\n```\n\nOn Ubuntu:\nIf the install process failed, you can try:\n```bash\nsudo apt install libopenmpi-dev,libopenmpi-bin,libopenmpi-doc\n```\n\n## :bricks: Technical Components\n\nAPPFL is primarily composed of the following six technical components\n\n* Aggregator: APPFL supports several popular algorithms to aggregate one or several client local models.\n* Scheduler: APPFL supports several synchronous and asynchronous scheduling algorithms at the server-side to deal with different arrival times of client local models.\n* Trianer: APPFL supports several client local trainers for various training tasks.\n* Privacy: APPFL supprots several global/local differential privacy schemes.\n* Communicator: APPFL supports MPI for single-machine/cluster simulation, and gRPC and Globus Compute with authenticator for secure distributed training.\n* Compressor: APPFL supports several lossy compressors for model parameters, including [SZ2](https://github.com/szcompressor/SZ), [SZ3](https://github.com/szcompressor/SZ3), [ZFP](https://pypi.org/project/zfpy/), and [SZx](https://github.com/szcompressor/SZx).\n\n## :bulb: Framework Overview\n\u003cp align=\"center\"\u003e\n  \u003cimg src='docs/_static/design-logic-new.jpg' style=\"width: 85%; height: auto;\"/\u003e\n\u003c/p\u003e\n\nIn the design of the APPFL framework, we essentially create the server agent and client agent, using the six technical components above as building blocks, to act on behalf of the FL server and clients to conduct FL experiments. For more details, please refer to our [documentation](http://appfl.rtfd.io/).\n\n## :page_facing_up: Citation\nIf you find APPFL useful for your research or development, please consider citing the following papers:\n```\n@article{li2024advances,\n  title={Advances in APPFL: A Comprehensive and Extensible Federated Learning Framework},\n  author={Li, Zilinghan and He, Shilan and Yang, Ze and Ryu, Minseok and Kim, Kibaek and Madduri, Ravi},\n  journal={arXiv preprint arXiv:2409.11585},\n  year={2024}\n}\n\n@inproceedings{ryu2022appfl,\n  title={APPFL: open-source software framework for privacy-preserving federated learning},\n  author={Ryu, Minseok and Kim, Youngdae and Kim, Kibaek and Madduri, Ravi K},\n  booktitle={2022 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW)},\n  pages={1074--1083},\n  year={2022},\n  organization={IEEE}\n}\n```\n\n## :trophy: Acknowledgements\n\nThis material is based upon work supported by the U.S. Department of Energy, Office of Science, under contract number DE-AC02-06CH11357.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FAPPFL%2FAPPFL","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FAPPFL%2FAPPFL","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FAPPFL%2FAPPFL/lists"}