https://github.com/bendangnuksung/dynabatch
dynabatch is a PyTorch/Hugging Face batching utility that sorts variable-length text by difficulty, then dynamically increases batch size on easier samples using a pre-trained VRAM predictor to improve GPU utilization and throughput while reducing OOM risk with fallback handling.
https://github.com/bendangnuksung/dynabatch
dataloader dynamic-batching huggingface huggingface-trainer machine-translation pytorch sampler transformers vram-optimization
Last synced: 18 days ago
JSON representation
dynabatch is a PyTorch/Hugging Face batching utility that sorts variable-length text by difficulty, then dynamically increases batch size on easier samples using a pre-trained VRAM predictor to improve GPU utilization and throughput while reducing OOM risk with fallback handling.
- Host: GitHub
- URL: https://github.com/bendangnuksung/dynabatch
- Owner: bendangnuksung
- License: mit
- Created: 2026-04-05T09:21:58.000Z (2 months ago)
- Default Branch: main
- Last Pushed: 2026-04-21T15:46:22.000Z (about 2 months ago)
- Last Synced: 2026-04-21T17:35:46.553Z (about 2 months ago)
- Topics: dataloader, dynamic-batching, huggingface, huggingface-trainer, machine-translation, pytorch, sampler, transformers, vram-optimization
- Language: Python
- Homepage:
- Size: 2.85 MB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE