https://github.com/predibase/lorax

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

fine-tuning gpt llama llm llm-inference llm-serving llmops lora model-serving pytorch transformers

Last synced: 12 May 2025

https://github.com/predibase/llm_distillation_playbook

Best practices for distilling large language models.

Last synced: 05 Apr 2025

https://github.com/predibase/lora_bakeoff

Last synced: 09 Aug 2025