https://github.com/torchpipe/torchpipe

Serving Inside Pytorch
https://github.com/torchpipe/torchpipe

deployment inference llm-serving pipeline-parallelism pytorch ray serve serving tensorrt torch2trt triton-inference-server

Last synced: 24 days ago
JSON representation

Serving Inside Pytorch

• Host: GitHub
• URL: https://github.com/torchpipe/torchpipe
• Owner: torchpipe
• License: apache-2.0
• Created: 2023-10-24T10:42:00.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2026-01-18T15:20:02.000Z (2 months ago)
• Last Synced: 2026-01-18T19:15:08.241Z (2 months ago)
• Topics: deployment, inference, llm-serving, pipeline-parallelism, pytorch, ray, serve, serving, tensorrt, torch2trt, triton-inference-server
• Language: Python
• Homepage: https://torchpipe.github.io/torchpipe/
• Size: 42.7 MB
• Stars: 170
• Watchers: 5
• Forks: 13
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project