https://github.com/saurabh0402/llm-chhotu
An on-device LLM chat app that runs on your android phones 📱
https://github.com/saurabh0402/llm-chhotu
android chat llm react-native
Last synced: 27 days ago
JSON representation
An on-device LLM chat app that runs on your android phones 📱
- Host: GitHub
- URL: https://github.com/saurabh0402/llm-chhotu
- Owner: saurabh0402
- Created: 2026-05-19T16:51:12.000Z (about 2 months ago)
- Default Branch: main
- Last Pushed: 2026-06-06T06:35:12.000Z (about 1 month ago)
- Last Synced: 2026-06-14T08:33:45.340Z (27 days ago)
- Topics: android, chat, llm, react-native
- Language: TypeScript
- Homepage:
- Size: 2.84 MB
- Stars: 1
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# LLM Chhotu
LLM Chhotu is your own LLM, running locally in your mobile phone - one you can talk to while being offline and get it to do actions for you.
## ToDo's
- [x] Bootstrap
- [x] Learn React Native and setup a simple UI
- [x] Add Gemma
- [x] Add simple chatting with LLM
- [x] Message parsing to segragate reasoning
- [ ] Pass context to LLM
- [x] Add tools support
- [x] Add a simple tool and check behavior
- [x] Handle tool call loop in `runCompletion`
- [x] Handle multiple thinking blocks, and tool call in `Chat`
- [x] Add an actual, working tool
- [ ] Refine Llama configuration to increase speed
- [ ] Get API keys from user and use them
- [ ] Add some awesome tools
- [ ] Add image support
- [ ] Add embeddings support
- [ ] Add audio support
- [ ] Add more models
# References
## React Native
- [React Native Docs](https://reactnative.dev/docs/getting-started)
## LLMs and its relatives
- [EdgeLLM](https://github.com/MekkCyber/EdgeLLM/tree/main)
- [LLM Inference on Edge](https://huggingface.co/blog/llm-inference-on-edge)
- Gemma Quantised, HuggingFace
- [Gemma 4 E4B](https://huggingface.co/unsloth/gemma-4-E4B-it-GGUF?show_file_info=gemma-4-E4B-it-UD-IQ3_XXS.gguf)
- [Gemma 4 E2B](https://huggingface.co/unsloth/gemma-4-E2B-it-GGUF?show_file_info=gemma-4-E2B-it-UD-IQ2_M.gguf)
## Packages
- [llama.rn](https://github.com/mybigday/llama.rn)
- [react-native-fs](https://www.npmjs.com/package/@dr.pogodin/react-native-fs#downloadfileoptionst)
- [react-native-progress](https://www.npmjs.com/package/react-native-progress)
- [react-native-background-downloader](https://github.com/kesha-antonov/react-native-background-downloader)
- [react-native-gifted-chat](https://github.com/faridsafi/react-native-gifted-chat)
- [Notifee](https://notifee.app/)
- [React Native Animated](https://docs.swmansion.com/react-native-reanimated/docs/fundamentals/getting-started/)
## Future Exploration
- [ExecuTorch](https://docs.swmansion.com/react-native-executorch/)
## Gemma
- [Function calling with Gemma](https://ai.google.dev/gemma/docs/capabilities/text/function-calling-gemma4)
## Tools, Tools, Everywhere
- ~[duckduckgo search](https://duck-duck-scrape.js.org/)~
- [Brave Search API](https://api-dashboard.search.brave.com/app/plans)
- [searxng](https://docs.searxng.org/user/index.html)
- [Mozilla Readability](https://github.com/mozilla/readability)
- [react-native linking](https://reactnative.dev/docs/linking)
- [react-native common intents](https://github.com/wahdatjan/react-native-common-intents/blob/master/src/index.js)