{"id":14964746,"url":"https://github.com/astrabert/qdurllm","last_synced_at":"2025-10-05T09:30:32.006Z","repository":{"id":247130764,"uuid":"824767498","full_name":"AstraBert/qdurllm","owner":"AstraBert","description":"Search your favorite websites and chat with them, on your desktop🌐","archived":false,"fork":false,"pushed_at":"2025-01-14T12:57:42.000Z","size":1111,"stargazers_count":26,"open_issues_count":5,"forks_count":2,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-01-20T16:06:39.290Z","etag":null,"topics":["docker-compose","gemma","gradio","langchain","llamacpp","llm","local-ai","python","qdrant","search-engine"],"latest_commit_sha":null,"homepage":"https://astrabert.github.io/qdurllm/","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/AstraBert.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-07-05T22:40:02.000Z","updated_at":"2025-01-18T12:29:50.000Z","dependencies_parsed_at":"2024-09-13T22:42:17.130Z","dependency_job_id":"8958be9a-7359-4988-b353-5d72ac770ddc","html_url":"https://github.com/AstraBert/qdurllm","commit_stats":{"total_commits":11,"total_committers":2,"mean_commits":5.5,"dds":"0.36363636363636365","last_synced_commit":"6d6951f17890b11deab6a45fca0b7b34de489909"},"previous_names":["astrabert/qdurllm"],"tags_count":2,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AstraBert%2Fqdurllm","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AstraBert%2Fqdurllm/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AstraBert%2Fqdurllm/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AstraBert%2Fqdurllm/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/AstraBert","download_url":"https://codeload.github.com/AstraBert/qdurllm/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":235378949,"owners_count":18980492,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["docker-compose","gemma","gradio","langchain","llamacpp","llm","local-ai","python","qdrant","search-engine"],"created_at":"2024-09-24T13:33:43.339Z","updated_at":"2025-10-05T09:30:32.001Z","avatar_url":"https://github.com/AstraBert.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003ch1 align=\"center\"\u003eqdurllm\u003c/h1\u003e\r\n\u003ch2 align=\"center\"\u003eSearch your favorite websites and chat with them, on your desktop🌐\u003c/h2\u003e\r\n\r\n# Docs in active development!👷‍♀️\r\n\r\nThey will be soon available on: https://astrabert.github.io/qdurllm/\r\n\r\nIn the meantime, refer to the **Quickstart guide** in this README!\r\n\r\n## Quickstart\r\n\r\n### 1. Prerequisites\r\n\r\n- [`conda`](https://docs.conda.io/projects/conda/en/latest/user-guide/getting-started.html) package manager\r\n- [`docker`](https://www.docker.com/) and [`docker compose`](https://docs.docker.com/compose/).\r\n\r\n### 2. Installation\r\n\r\n\u003e [!IMPORTANT]\r\n\u003e _This is only for the pre-release of `v1.0.0`, i.e. `v1.0.0-rc.0`_\r\n\r\n1. Clone the `january-2025` branch of this GitHub repo:\r\n\r\n```bash\r\ngit clone -b january-2025 --single-branch https://github.com/AstraBert/qdurllm.git\r\ncd qdurllm/\r\n```\r\n\r\n2. Create the `conda` environment:\r\n\r\n```bash\r\nconda env create -f environment.yml\r\n```\r\n\r\n3. Pull `qdrant` from Docker Hub:\r\n\r\n```bash\r\ndocker pull qdrant/qdrant\r\n```\r\n\r\n### 3. Launching\r\n\r\n1. Launch `qdrant` vector database services with `docker compose` (from within the `qdurllm` folder):\r\n\r\n```bash\r\ndocker compose up\r\n```\r\n\r\n2. Activate the `qdurllm` conda environment you just created:\r\n\r\n```bash\r\nconda activate qdurllm\r\n```\r\n\r\n3. Go inside the `app` directory and launch the Gradio application:\r\n\r\n```bash\r\ncd app/\r\npython3 app.py\r\n```\r\n\r\nYou should see the app running on `http://localhost:7860` once all the models are downloaded from HuggingFace Hub.\r\n\r\n## Relies on\r\n\r\n- [Qwen2.5-1.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct), with Apache 2.0 license\r\n- [nomic-ai/modernbert-embed-base](https://huggingface.co/nomic-ai/modernbert-embed-base), with Apache 2.0 license\r\n- [prithivida/Splade_PP_en_v1](https://huggingface.co/prithivida/Splade_PP_en_v1), with Apache 2.0 license\r\n\r\n\r\n## Give feedback!\r\n\r\nComment on the [**discussion thread created for this release**](https://github.com/AstraBert/qdurllm/discussions) with your feedback or create [**issues**](https://github.com/AstraBert/qdurllm/issues) :)\r\n\r\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fastrabert%2Fqdurllm","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fastrabert%2Fqdurllm","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fastrabert%2Fqdurllm/lists"}