{"id":21158729,"url":"https://github.com/aflah02/fsdp_experiments","last_synced_at":"2026-03-19T19:05:16.189Z","repository":{"id":249648747,"uuid":"832109648","full_name":"aflah02/FSDP_Experiments","owner":"aflah02","description":null,"archived":false,"fork":false,"pushed_at":"2024-08-02T17:51:53.000Z","size":1496,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-10-30T16:45:11.628Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"HTML","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/aflah02.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-07-22T11:24:28.000Z","updated_at":"2024-08-02T17:51:57.000Z","dependencies_parsed_at":"2024-11-20T12:44:17.529Z","dependency_job_id":null,"html_url":"https://github.com/aflah02/FSDP_Experiments","commit_stats":null,"previous_names":["aflah02/fsdp_experiments"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/aflah02/FSDP_Experiments","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/aflah02%2FFSDP_Experiments","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/aflah02%2FFSDP_Experiments/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/aflah02%2FFSDP_Experiments/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/aflah02%2FFSDP_Experiments/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/aflah02","download_url":"https://codeload.github.com/aflah02/FSDP_Experiments/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/aflah02%2FFSDP_Experiments/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29868535,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-02-26T18:42:30.764Z","status":"ssl_error","status_checked_at":"2026-02-26T18:41:47.936Z","response_time":89,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-20T12:33:13.463Z","updated_at":"2026-02-26T19:32:28.466Z","avatar_url":"https://github.com/aflah02.png","language":"HTML","funding_links":[],"categories":[],"sub_categories":[],"readme":"# FSDP Experiments\n\n## Setup Env\n\nI've used Conda for all my experiments and it has served me well. You may choose to use other environment managers such as Mamba, Poetry etc. and your Mileage may vary but any mature environment manager should do the job.\n\nFor Conda Users - \n\n- The python package details are present in `environment.yml`. The exact build details alongside python packages are present in `environment_with_build_info.yml`\n- To use the env file run - `conda env create -f YAML_FILE_PATH`\n\n## Running Instructions \n\nSince I am using Accelerate for DDP and FSDP, it is possible but hard to run it from the notebooks. So for the DDP and FSDP variants I have added `.py` files which can be run using `accelerate launch` commands.\n\n- For FSDP - `accelerate launch --config_file fsdp_config.yaml train_model_fsdp.py`\n- For DDP - `accelerate launch train_model_ddp.py`\n\nAll the file names clearly showcase the variant they present!","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Faflah02%2Ffsdp_experiments","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Faflah02%2Ffsdp_experiments","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Faflah02%2Ffsdp_experiments/lists"}