https://github.com/mohammadkaso/tiny_llama_mcp_flutter
edge_flutter enables seamless on-device Large Language Model inference using Apple's Neural Engine and Core ML, with automatic fallback to cloud models when device performance doesn't meet specified latency/memory targets.
https://github.com/mohammadkaso/tiny_llama_mcp_flutter
edge-ai flutter llama llm llm-inference mlc
Last synced: 3 months ago
JSON representation
edge_flutter enables seamless on-device Large Language Model inference using Apple's Neural Engine and Core ML, with automatic fallback to cloud models when device performance doesn't meet specified latency/memory targets.
- Host: GitHub
- URL: https://github.com/mohammadkaso/tiny_llama_mcp_flutter
- Owner: MohammadKaso
- License: mit
- Created: 2025-06-05T00:03:20.000Z (4 months ago)
- Default Branch: main
- Last Pushed: 2025-06-05T00:56:40.000Z (4 months ago)
- Last Synced: 2025-06-05T05:19:13.778Z (4 months ago)
- Topics: edge-ai, flutter, llama, llm, llm-inference, mlc
- Language: Swift
- Homepage:
- Size: 519 MB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- License: LICENSE