Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/jeffwigger/fastdynamicbatcher
FastDynamicBatcher is a library for batching inputs across requests to accelerate machine learning workloads
https://github.com/jeffwigger/fastdynamicbatcher
batching fastapi machine-learning
Last synced: 3 months ago
JSON representation
FastDynamicBatcher is a library for batching inputs across requests to accelerate machine learning workloads
- Host: GitHub
- URL: https://github.com/jeffwigger/fastdynamicbatcher
- Owner: JeffWigger
- License: mit
- Created: 2024-06-24T19:17:30.000Z (8 months ago)
- Default Branch: main
- Last Pushed: 2024-11-21T03:05:05.000Z (3 months ago)
- Last Synced: 2024-11-22T09:09:36.934Z (3 months ago)
- Topics: batching, fastapi, machine-learning
- Language: Python
- Homepage:
- Size: 45.9 KB
- Stars: 3
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE