{"id":21012619,"url":"https://github.com/developersdigest/ollama-anywhere","last_synced_at":"2025-05-15T04:33:20.174Z","repository":{"id":222368803,"uuid":"757091034","full_name":"developersdigest/ollama-anywhere","owner":"developersdigest","description":"Access your Ollama inference server running on your computer from anywhere. Set up with NextJS + Langchain JS LCEL + Ngrok","archived":false,"fork":false,"pushed_at":"2024-02-13T20:20:01.000Z","size":208,"stargazers_count":19,"open_issues_count":0,"forks_count":3,"subscribers_count":4,"default_branch":"main","last_synced_at":"2024-05-19T03:44:59.037Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/developersdigest.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null}},"created_at":"2024-02-13T19:44:45.000Z","updated_at":"2024-05-16T03:48:04.000Z","dependencies_parsed_at":"2024-02-13T20:57:17.784Z","dependency_job_id":null,"html_url":"https://github.com/developersdigest/ollama-anywhere","commit_stats":null,"previous_names":["developersdigest/ollama-anywhere"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/developersdigest%2Follama-anywhere","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/developersdigest%2Follama-anywhere/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/developersdigest%2Follama-anywhere/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/developersdigest%2Follama-anywhere/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/developersdigest","download_url":"https://codeload.github.com/developersdigest/ollama-anywhere/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":225327989,"owners_count":17457197,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-19T09:37:53.384Z","updated_at":"2024-11-19T09:37:53.985Z","avatar_url":"https://github.com/developersdigest.png","language":"TypeScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Ollama Anywhere README\n![Developers Digest GIF](https://media.giphy.com/media/5Qc9jVHQKmS7bQUQCe/giphy.gif)\n\n\n\nOllama Anywhere is a proof of concept project designed to enable seamless interaction with Ollama and the LLM's you have installed being able to access from anywhere, using any device. This  allows users to leverage the power of models like Llama 2, Mistral, Mixtral, etc. That they have locally on their computer,  making them accessible for inference directly from your computer or device. The project is crafted with responsiveness in mind, ensuring a smooth user experience on any device, whether it's your phone, tablet, or laptop.\n\n## Project Structure\n\nThe project is divided into two main components:\n\n### 1. next-web-app\n\n- A Next.js application that can be deployed to Vercel.\n- Features a chat UI for real-time interaction with the LLMs you have set up.\n- Responsive design to work seamlessly across devices.\n- To get started, deploy the Next.js app to Vercel following standard procedures.\n\n### 2. ngrok-server\n\n- A local server that creates a secure tunnel to your machine, enabling access to your LLMs from anywhere.\n- Requires a free ngrok account and an auth token.\n\n## Getting Started\n\n### Ollama Setup\n\n1. Visit [Ollama's website](https://ollama.com/) to download the application for macOS \u0026 Linux (Windows coming soon).\n2. After installation, select and download at least one model for inference from [Ollama's library](https://ollama.com/library/mistral).\n\n### ngrok Setup\n\n1. Sign up for a free ngrok account [here](https://ngrok.com/).\n2. Obtain your ngrok auth token from [this page](https://dashboard.ngrok.com/get-started/your-authtoken).\n3. Place the auth token in the `.env` file within the `ngrok-server` directory.\n\n### Installation\n\nEnsure to install dependencies for both the `ngrok-server` and the `next-web-app` directories by running `npm i` in each.\n\n## Usage\n\nOpen up each project in separate terminal tabs.\n\n- To run the ngrok-server, execute `node index.js`.\n- To run the Next.js app, use `npm run dev`.\n\n### Deployment\n\n- For a staging instance, run the `vercel` command.\n- For a production deployment, use `vercel --prod`.\n\nOnce everything is set up and the app is running locally or deployed to Vercel, running the ngrok server will allow you to access the deployed version/local host version from the terminal output. From there, enjoy interacting with your LLMs through Ollama Anywhere.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdevelopersdigest%2Follama-anywhere","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdevelopersdigest%2Follama-anywhere","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdevelopersdigest%2Follama-anywhere/lists"}