https://github.com/torchpipe/torchpipe
Serving Inside Pytorch
https://github.com/torchpipe/torchpipe
deployment inference llm-serving pipeline-parallelism pytorch ray serve serving tensorrt torch2trt triton-inference-server
Last synced: 7 months ago
JSON representation
Serving Inside Pytorch
- Host: GitHub
- URL: https://github.com/torchpipe/torchpipe
- Owner: torchpipe
- License: apache-2.0
- Created: 2023-10-24T10:42:00.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2024-10-25T10:39:39.000Z (12 months ago)
- Last Synced: 2024-10-27T20:19:56.035Z (12 months ago)
- Topics: deployment, inference, llm-serving, pipeline-parallelism, pytorch, ray, serve, serving, tensorrt, torch2trt, triton-inference-server
- Language: C++
- Homepage: https://torchpipe.github.io/
- Size: 39.9 MB
- Stars: 142
- Watchers: 6
- Forks: 12
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md