https://github.com/mlc-ai/mlc-llm

Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.
https://github.com/mlc-ai/mlc-llm

language-model llm machine-learning-compilation tvm

Last synced: about 2 months ago
JSON representation

Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.

• Host: GitHub
• URL: https://github.com/mlc-ai/mlc-llm
• Owner: mlc-ai
• License: apache-2.0
• Created: 2023-04-29T01:59:25.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-05-18T03:44:59.000Z (4 months ago)
• Last Synced: 2024-05-18T03:48:20.065Z (4 months ago)
• Topics: language-model, llm, machine-learning-compilation, tvm
• Language: Python
• Homepage: https://llm.mlc.ai/docs
• Size: 27.8 MB
• Stars: 17,208
• Watchers: 164
• Forks: 1,337
• Open Issues: 142
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-local-llms - mlc-llm
• awesome-llamas - mlc-llm - Running LLaMA2 on iOS devices natively using GPU acceleration, see [example](https://twitter.com/bohanhou1998/status/1681682445937295360) (Libraries)
• Awesome-LLM-Productization - mlc-llm - Enable everyone to develop, optimize and deploy AI models natively on everyone's devices. (Models and Tools / LLM Deployment)
• awesome - mlc-ai/mlc-llm - Universal LLM Deployment Engine with ML Compilation (Python)
• awesome-ai - MLC LLM - ai/mlc-llm?style=social) - 代表了一种新的思路，serverless，允许在手机、电脑等终端上直接运行 LLM (LLM)
• awesome-llm-and-aigc - MLC LLM - ai/mlc-llm?style=social"/> : Enable everyone to develop, optimize and deploy AI models natively on everyone's devices. [mlc.ai/mlc-llm](https://mlc.ai/mlc-llm/) (Summary)
• ai-game-devtools - MLC LLM
• StarryDivineSky - mlc-ai/mlc-llm
• awesome-cuda-and-hpc - MLC LLM - ai/mlc-llm?style=social"/> : Enable everyone to develop, optimize and deploy AI models natively on everyone's devices. [mlc.ai/mlc-llm](https://mlc.ai/mlc-llm/) (Frameworks)
• awesome-production-machine-learning - MLC LLM - ai/mlc-llm.svg?style=social) - MLC LLM is a universal solution that allows any language models to be deployed natively on a diverse set of hardware backends and native applications, plus a productive framework for everyone to further optimize model performance for their own use cases. (Industry Strength NLP)
• AiTreasureBox - mlc-ai/mlc-llm - 09-13_18627_1](https://img.shields.io/github/stars/mlc-ai/mlc-llm.svg) |Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.| (Repos)