{"id":13438639,"url":"https://github.com/Oneflow-Inc/oneflow","last_synced_at":"2025-03-20T06:30:56.467Z","repository":{"id":36951521,"uuid":"81634683","full_name":"Oneflow-Inc/oneflow","owner":"Oneflow-Inc","description":"OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.","archived":false,"fork":false,"pushed_at":"2025-03-18T10:45:34.000Z","size":86575,"stargazers_count":7475,"open_issues_count":599,"forks_count":820,"subscribers_count":245,"default_branch":"master","last_synced_at":"2025-03-19T23:49:02.023Z","etag":null,"topics":["cuda","deep-learning","deep-neural-networks","distributed","machine-learning","ml","neural-network"],"latest_commit_sha":null,"homepage":"http://www.oneflow.org","language":"C++","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Oneflow-Inc.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":".github/CODEOWNERS","security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-02-11T06:09:53.000Z","updated_at":"2025-03-19T21:44:53.000Z","dependencies_parsed_at":"2023-12-25T04:27:47.921Z","dependency_job_id":"76fa096e-92f6-4c22-b83b-ad0044a7dd0a","html_url":"https://github.com/Oneflow-Inc/oneflow","commit_stats":{"total_commits":8973,"total_committers":182,"mean_commits":49.3021978021978,"dds":0.8904491251532375,"last_synced_commit":"bf9ae024b339b182d60a1bbd2a945c0d678eb35d"},"previous_names":[],"tags_count":39,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Oneflow-Inc%2Foneflow","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Oneflow-Inc%2Foneflow/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Oneflow-Inc%2Foneflow/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Oneflow-Inc%2Foneflow/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Oneflow-Inc","download_url":"https://codeload.github.com/Oneflow-Inc/oneflow/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":244565154,"owners_count":20473221,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["cuda","deep-learning","deep-neural-networks","distributed","machine-learning","ml","neural-network"],"created_at":"2024-07-31T03:01:07.107Z","updated_at":"2025-03-20T06:30:56.440Z","avatar_url":"https://github.com/Oneflow-Inc.png","language":"C++","readme":"# OneFlow\n\nOneFlow is a deep learning framework designed to be **user-friendly, scalable and efficient**. With OneFlow, it is easy to:\n\n- program a model with [**PyTorch-like API**](https://oneflow.readthedocs.io/en/master/)\n- scale a model to n-dimensional-parallel execution with the [**Global Tensor**](https://docs.oneflow.org/en/master/cookies/global_tensor.html)\n- accelerate/deploy a model with the [**Graph Compiler**](https://oneflow.readthedocs.io/en/master/graph.html).\n\n[![Simple CI](https://github.com/Oneflow-Inc/oneflow/actions/workflows/simple.yml/badge.svg)](https://github.com/Oneflow-Inc/oneflow/actions/workflows/simple.yml)\n[![Nightly Docker Image](https://github.com/Oneflow-Inc/docker-images/actions/workflows/oneflow-nightly.yml/badge.svg)](https://github.com/Oneflow-Inc/docker-images/actions/workflows/oneflow-nightly.yml)\n[![Nightly Release](https://github.com/Oneflow-Inc/oneflow/actions/workflows/release.yml/badge.svg)](https://github.com/Oneflow-Inc/oneflow/actions/workflows/release.yml)\n[![Documentation](https://readthedocs.org/projects/oneflow/badge/?version=master)](https://oneflow.readthedocs.io/en/master/?badge=master)\n\n## Latest News\n\n- Version 1.0.0 is out!\n  - [Full changelog](https://github.com/Oneflow-Inc/oneflow/releases/tag/v1.0.0)\n\n## Publication\n\n- [OneFlow: Redesign the Distributed Deep Learning Framework from Scratch](https://arxiv.org/abs/2110.15032)\n\n## System Requirements\n\n### General\n- Linux\n- Python 3.7, 3.8, 3.9, 3.10, 3.11\n\n### CUDA\n- CUDA arch 60 or above\n- CUDA Toolkit version 10.0 or above\n- Nvidia driver version 440.33 or above\n\n  OneFlow will work on a minimum supported driver, and any driver beyond. For more information, please refer to [CUDA compatibility documentation](https://docs.nvidia.com/deploy/cuda-compatibility/index.html).\n\n## Install\n\n### Preinstall docker image\n\n```\ndocker pull oneflowinc/oneflow:nightly-cuda11.8\n```\n\n### Pip Install\n\n- (**Highly recommended**) Upgrade pip\n\n  ```\n  python3 -m pip install --upgrade pip #--user\n  ```\n\n- To install latest stable release of OneFlow with CUDA support:\n\n  ```bash\n  python3 -m pip install oneflow\n  ```\n\n- To install nightly release of OneFlow with CPU-only support:\n\n  ```bash\n  python3 -m pip install --pre oneflow -f https://oneflow-staging.oss-cn-beijing.aliyuncs.com/branch/master/cpu\n  ```\n\n- To install nightly release of OneFlow with CUDA support:\n\n  ```bash\n  python3 -m pip install --pre oneflow -f https://oneflow-staging.oss-cn-beijing.aliyuncs.com/branch/master/cu118\n  ```\n\n  If you are in China, you could run this to have pip download packages from domestic mirror of pypi:\n  ```\n  python3 -m pip config set global.index-url https://pypi.tuna.tsinghua.edu.cn/simple\n  ```\n  For more information on this, please refer to [pypi 镜像使用帮助](https://mirror.tuna.tsinghua.edu.cn/help/pypi/)\n\n### Install from Source\n\n\u003cdetails\u003e\n\u003csummary\u003eClone Source Code\u003c/summary\u003e\n\n- #### Option 1: Clone source code from GitHub\n\n  ```bash\n  git clone https://github.com/Oneflow-Inc/oneflow.git\n  ```\n\n- #### Option 2: Download from Aliyun(Only available in China)\n\n  ```bash\n  curl https://oneflow-public.oss-cn-beijing.aliyuncs.com/oneflow-src.zip -o oneflow-src.zip\n  unzip oneflow-src.zip\n  ```\n\n  \u003c/details\u003e\n\n\u003cdetails\u003e\n\u003csummary\u003eBuild OneFlow\u003c/summary\u003e\n\n- Install dependencies\n  ```\n  apt install -y libopenblas-dev nasm g++ gcc python3-pip cmake autoconf libtool\n  ```\n  These dependencies are preinstalled in offical conda environment and docker image, you can use the offical conda environment [here](https://github.com/Oneflow-Inc/conda-env) or use the docker image by:\n  ```bash\n  docker pull oneflowinc/manylinux2014_x86_64_cuda11.2\n  ```\n- In the root directory of OneFlow source code, run:\n\n  ```\n  mkdir build\n  cd build\n  ```\n\n- Config the project, inside `build` directory:\n\n  - If you are in China\n\n    config for CPU-only like this:\n\n    ```\n    cmake .. -C ../cmake/caches/cn/cpu.cmake\n    ```\n\n    config for CUDA like this:\n\n    ```\n    cmake .. -C ../cmake/caches/cn/cuda.cmake -DCMAKE_CUDA_ARCHITECTURES=80 -DCUDA_TOOLKIT_ROOT_DIR=/usr/local/cuda -DCUDNN_ROOT_DIR=/usr/local/cudnn\n    ```\n\n  - If you are not in China\n\n    config for CPU-only like this:\n\n    ```\n    cmake .. -C ../cmake/caches/international/cpu.cmake\n    ```\n\n    config for CUDA like this:\n\n    ```\n    cmake .. -C ../cmake/caches/international/cuda.cmake -DCMAKE_CUDA_ARCHITECTURES=80 -DCUDA_TOOLKIT_ROOT_DIR=/usr/local/cuda -DCUDNN_ROOT_DIR=/usr/local/cudnn\n    ```\n    Here the DCMAKE\\_CUDA\\_ARCHITECTURES macro is used to specify the CUDA architecture, and the DCUDA\\_TOOLKIT\\_ROOT\\_DIR and DCUDNN\\_ROOT\\_DIR macros are used to specify the root path of the CUDA Toolkit and CUDNN.\n\n- Build the project, inside `build` directory, run:\n\n  ```\n  make -j$(nproc)\n  ```\n\n- Add oneflow to your PYTHONPATH, inside `build` directory, run:\n\n  ```\n  source source.sh\n  ```\n\n  Please note that this change is not permanent.\n\n- Simple validation\n\n  ```\n  python3 -m oneflow --doctor\n  ```\n\n  \u003c/details\u003e\n\n### Troubleshooting\n\nPlease refer to [troubleshooting](docs/source/troubleshooting.md) for common issues you might encounter when compiling and running OneFlow.\n\n## Getting Started\n\n- Please refer to [QUICKSTART](https://docs.oneflow.org/en/master/basics/01_quickstart.html)\n- 中文版请参见 [快速上手](https://docs.oneflow.org/master/basics/01_quickstart.html)\n\n## Documentation\n\n- [API Reference](https://oneflow.readthedocs.io/en/master/)\n- [Usage \u0026 Design Docs](http://docs.oneflow.org/)\n- [System Design](https://docs.oneflow.org/en/v0.4.0/basics_topics/essentials_of_oneflow.html)\n\n## Model Zoo and Benchmark\n\n- [Libai(Toolbox for Parallel Training Large-Scale Transformer Models)](https://github.com/Oneflow-Inc/libai)\n  - [BERT-large](https://libai.readthedocs.io/en/latest/tutorials/get_started/quick_run.html)\n  - [GPT](https://libai.readthedocs.io/en/latest/modules/libai.models.html#id5)\n  - [T5](https://libai.readthedocs.io/en/latest/modules/libai.models.html#id4)\n  - [VisionTransformer](https://libai.readthedocs.io/en/latest/modules/libai.models.html#id1)\n  - [SwinTransformer](https://libai.readthedocs.io/en/latest/modules/libai.models.html#id2)\n- [FlowVision(Toolbox for Computer Vision Datasets, SOTA Models and Utils)](https://github.com/Oneflow-Inc/vision)\n- [OneFlow-Models(Outdated)](https://github.com/Oneflow-Inc/models)\n  - [ResNet-50](https://github.com/Oneflow-Inc/models/tree/main/Vision/classification/image/resnet50)\n  - [Wide\u0026Deep](https://github.com/Oneflow-Inc/models/tree/main/RecommenderSystems/wide_and_deep)\n- [OneFlow-Benchmark(Outdated)](https://github.com/Oneflow-Inc/OneFlow-Benchmark)\n\n## Communication\n\n- [GitHub issues](https://github.com/Oneflow-Inc/oneflow/issues): any install, bug, feature issues.\n- [www.oneflow.org](http://www.oneflow.org): brand related information.\n\n- ### 中文\n\n  - QQ 群: 331883\n  - 微信号（加好友入交流群）: OneFlowXZS\n  - [知乎](https://www.zhihu.com/org/oneflow-17)\n\n- ### International\n  - [Discord](https://discord.gg/4kpjGA5bZY)\n  - [Twitter](https://twitter.com/OneFlowNews)\n  - [LinkedIn](https://www.linkedin.com/company/oneflow-inc)\n  - [Medium](https://oneflow2020.medium.com)\n\n## The Team\n\nOneFlow was originally developed by [OneFlow Inc](http://www.oneflow.org) and [Zhejiang Lab](http://www.zhejianglab.com/).\n\n## License\n\n[Apache License 2.0](LICENSE)\n","funding_links":[],"categories":["C++","\u003ca name=\"cpp\"\u003e\u003c/a\u003eC++","Training","Frameworks-for-Training","Frameworks for Training","Deep Learning Framework","Tools","其他_机器学习与深度学习","Table of Contents"],"sub_categories":["Frameworks for Training","Popular-LLM","High-Level DL APIs","AI - Frameworks and Toolkits"],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FOneflow-Inc%2Foneflow","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FOneflow-Inc%2Foneflow","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FOneflow-Inc%2Foneflow/lists"}