Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
Projects in Awesome Lists tagged with local-inference
A curated list of projects in awesome lists tagged with local-inference .
https://github.com/SJTU-IPADS/PowerInfer
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
bamboo-7b falcon large-language-models llama llm llm-inference local-inference
Last synced: 31 Jul 2024
https://github.com/efeslab/fiddler
Fast Inference of MoE Models with CPU-GPU Orchestration
llm llm-inference local-inference mixtral-8x7b mixture-of-experts
Last synced: 01 Aug 2024
