https://github.com/dphnai/aphrodite-engine

Large-scale LLM inference engine

api-rest cuda inference-engine inferentia intel lora machine-learning rocm speculative-decoding tpu

Last synced: 04 Jul 2026