https://github.com/google-ai-edge/LiteRT-LM
https://github.com/google-ai-edge/LiteRT-LM
Last synced: 2 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/google-ai-edge/LiteRT-LM
- Owner: google-ai-edge
- License: apache-2.0
- Created: 2025-04-14T21:00:20.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2026-04-22T02:10:31.000Z (2 months ago)
- Last Synced: 2026-04-22T03:35:06.159Z (2 months ago)
- Language: C++
- Size: 581 MB
- Stars: 4,113
- Watchers: 58
- Forks: 402
- Open Issues: 181
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
Awesome Lists containing this project
- awesome-local-llm - LiteRT-LM - Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices (Inference engines)
- awesome-ai-coding - LiteRT-LM - ai-edge/LiteRT-LM?style=flat-square&label=%E2%98%85)](https://github.com/google-ai-edge/LiteRT-LM) | Google AI Edge | Edge device model inference engine. | Highly optimized for mobile devices and embedded hardware. | (⚡ LLM Inference & Local Serving Engines)
- awesome-opensource-ai - LiteRT-LM - Production-ready runtime for deploying LLMs on edge devices with low-latency inference and optimized hardware paths for mobile and embedded platforms.  (3. Inference Engines & Serving)
- AiTreasureBox - google-ai-edge/LiteRT-LM - 04-22_4182_113](https://img.shields.io/github/stars/google-ai-edge/LiteRT-LM.svg)|| (Repos)
- awesome-production-machine-learning - LiteRT-LM - ai-edge/LiteRT-LM.svg?cacheSeconds=86400) - LiteRT-LM is Google's production-ready, high-performance inference framework for deploying Large Language Models on edge devices, with cross-platform support for Android, iOS, Web, Desktop, and IoT. (Deployment and Serving)