{"id":20829249,"url":"https://github.com/iakashpaul/portal","last_synced_at":"2025-05-07T21:22:04.680Z","repository":{"id":217830105,"uuid":"744865224","full_name":"iakashpaul/Portal","owner":"iakashpaul","description":"Android app for the Hole in your Palm project, making LLMs accessible on-device!","archived":false,"fork":false,"pushed_at":"2024-05-03T10:55:45.000Z","size":20441,"stargazers_count":17,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-04-30T02:02:42.812Z","etag":null,"topics":["android","large-language-model","large-language-models","llama","llm","mistral"],"latest_commit_sha":null,"homepage":"https://akashpaul.com/portal-app","language":"Kotlin","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/iakashpaul.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-01-18T06:53:11.000Z","updated_at":"2025-04-09T10:28:43.000Z","dependencies_parsed_at":"2024-08-03T07:59:15.838Z","dependency_job_id":null,"html_url":"https://github.com/iakashpaul/Portal","commit_stats":{"total_commits":37,"total_committers":2,"mean_commits":18.5,"dds":"0.027027027027026973","last_synced_commit":"faa732524d2e34d026146c299e3de5bf9adbb82a"},"previous_names":["iakashpaul/portal"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iakashpaul%2FPortal","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iakashpaul%2FPortal/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iakashpaul%2FPortal/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/iakashpaul%2FPortal/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/iakashpaul","download_url":"https://codeload.github.com/iakashpaul/Portal/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":252955166,"owners_count":21831062,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["android","large-language-model","large-language-models","llama","llm","mistral"],"created_at":"2024-11-17T23:19:46.380Z","updated_at":"2025-05-07T21:22:04.611Z","avatar_url":"https://github.com/iakashpaul.png","language":"Kotlin","funding_links":[],"categories":["Infrastructure / Deployment of LLMs on Device"],"sub_categories":["Deployment Frameworks"],"readme":"# Portal: Hole in your Palm\n\u003eTheme : AI for India [Hasgeek Hackathon Submission](http://has.gy/W7bW)\n\nAndroid app for the ```Hole in your Palm``` project, making LLMs accessible on-device using the [🦙 Llama.cpp project](https://github.com/ggerganov/llama.cpp)\n\n\u003cimg src=\"https://raw.githubusercontent.com/iakashpaul/iakashpaul.github.io/master/assets/images/image-hole-in-palm.png\" width=\"300px\"\u003e\n\n## Android App \n\n[APK](https://drive.google.com/file/d/1NDtp3siDcvRpAMn4kyIDt8QNzBNq0GC_/view?usp=drivesdk)\n\nComing soon to the Play Store \u0026 Indus AppStore\n\n## Video\n\n[Youtube](https://youtu.be/EY1_139uccc)\n\n## Slides\n\n[PPT](https://docs.google.com/presentation/d/1vd319CIffL_MaXt-FbTPDNMprASr_-WR/edit?usp=sharing\u0026ouid=116547059781397399357\u0026rtpof=true\u0026sd=true)\n\n## Background \n\n\u003e Through this initiative I’d like to revisit the almost 20 year old experiment of [‘The Hole in the Wall’](https://en.wikipedia.org/wiki/Minimally_invasive_education) project by Sugata Mitra, which incorporated minimally invasive education by having a computer kiosk embedded in a wall at less fortunate locations across India.\nGiven the increased prevalence of smartphones throughout the country but with often limited internet/network coverage in far flung locations or restricted internet access. This along with families deciding on activating/deactivating internet plans to avoid paying high fees/rental plans leads to the friction of thinking about cost before getting answers to a question/query at any point of time.\nI propose creating an Android app which can incorporate few of the smaller LLMs for tasks like general QnA, coding help, translation etc. Thereby making educational resources more accessible \u0026 available to users without depending on costly cloud GPUs or active internet connections. Adding modalities like STT/TTS on device along with possible image generation could be extensions to this app down the road.\n\n## Roadmap\n\n* Extend llama.cpp's example Android app with OpenCL support to make use CPU \u0026 GPU, already verified 1.6b, 3b \u0026 7b models running at decent tok/s at Q4/Q8 quantization on CPU via termux \u0026 this app\n\n* Add support to incorporate custom data \u0026 vector-db for RAG based QnA on-device \u0026 toggling to code assistance tasks\n\n* Fix bugs with message history \u0026 unloading models completely\n\n\n\u003chr\u003e\n\n## Screenshots\n\n\u003cimg src=\"portal-2.png\" height=\"500px\"\u003e\u003cimg src=\"portal-1.png\" height=\"500px\"\u003e\n\n### Long term goals\n\n* Tool/Function calling via grammar \u0026 file output generation/sharing\n\n* Look at incorporating on-device STT or Whisper based STT model for translation into English from regional language directly \u0026 respond via TTS with VAD based interruptibility\n\n* Android Assistant integration, widget on home/lock screens \u0026 notification shade\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fiakashpaul%2Fportal","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fiakashpaul%2Fportal","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fiakashpaul%2Fportal/lists"}