{"id":17526895,"url":"https://github.com/SSK-14/WizSearch","last_synced_at":"2025-03-06T06:31:02.845Z","repository":{"id":243053223,"uuid":"800588617","full_name":"SSK-14/WizSearch","owner":"SSK-14","description":"Your intelligent ally for effortless information retrieval and seamless browsing across documents and the web.","archived":false,"fork":false,"pushed_at":"2024-08-26T13:57:41.000Z","size":14087,"stargazers_count":18,"open_issues_count":0,"forks_count":6,"subscribers_count":2,"default_branch":"main","last_synced_at":"2024-08-26T16:25:06.222Z","etag":null,"topics":["gpt-4o","langfuse","llm","multimodal","ollama","openai","perplexity","qdrant","rag","replicate","streamlit","tavily"],"latest_commit_sha":null,"homepage":"https://wizsearch.streamlit.app/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/SSK-14.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-05-14T16:07:49.000Z","updated_at":"2024-08-26T14:05:57.000Z","dependencies_parsed_at":"2024-06-06T13:23:03.820Z","dependency_job_id":"2ab5c93c-a3a4-4331-8202-a03578f0ae18","html_url":"https://github.com/SSK-14/WizSearch","commit_stats":null,"previous_names":["ssk-14/wizsearch"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SSK-14%2FWizSearch","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SSK-14%2FWizSearch/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SSK-14%2FWizSearch/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SSK-14%2FWizSearch/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/SSK-14","download_url":"https://codeload.github.com/SSK-14/WizSearch/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":242161462,"owners_count":20081876,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["gpt-4o","langfuse","llm","multimodal","ollama","openai","perplexity","qdrant","rag","replicate","streamlit","tavily"],"created_at":"2024-10-20T15:02:36.079Z","updated_at":"2025-03-06T06:31:02.833Z","avatar_url":"https://github.com/SSK-14.png","language":"Python","funding_links":[],"categories":["Python"],"sub_categories":[],"readme":"# ✨ WizSearch\nYour intelligent ally for effortless data retrieval across documents and seamless browsing the web.\n\n## Demo 🎬\n1. Get your API key [groq](https://console.groq.com/keys)\n2. Checkout https://wizsearch.streamlit.app/\n\n[Checkout the features 💻](./docs/FEATURES.md)\n[Quick start with Ollama in local 🦙✨](./docs/OLLAMA.md)\n\nhttps://github.com/user-attachments/assets/fa4fae96-6e78-474d-9d90-2e1d64833008\n\n## How we built it 🛠️\nWe built Wiz Search using the following components:\n- **LLM/VLM:** Open source models like llama3.1, mistral, LLaVA, etc are supported by platforms such as [Ollama](https://ollama.ai/) and [Groq](https://console.groq.com/docs/models). Closed source models like gpt-4o, gpt-4 supported by [OpenAI](https://platform.openai.com/docs/models) and [Azure OpenAI](https://azure.microsoft.com/en-in/products/ai-services/openai-service) for natural language understanding and generation. [Litellm](https://docs.litellm.ai/docs/providers) is used to support all the models.\n- **Embeddings:** `jina-embeddings-v3` and `BM25` using [fastembed](https://github.com/qdrant/fastembed) to enhance search relevance.\n- **Intelligent Search:** [Tavily](https://tavily.com/) for advanced search capabilities.\n- **Data Extraction:** [MarkItDown](https://github.com/microsoft/markitdown) for converting documents to text.\n- **Vector Databases:** [Qdrant](https://qdrant.tech/) for efficient data storage and retrieval.\n- **Observability:** [Langfuse](https://www.langfuse.com/) for monitoring and observability.\n- **UI:** [Streamlit](https://streamlit.io/) for creating an interactive and user-friendly interface.\n\n![Architecture](./src/assets/arch.png)\n\n## Run The Application ⚙️\n1. Clone the repo\n```\ngit clone https://github.com/SSK-14/WizSearch.git\n```\n\n2. Install required libraries\n\n- Create virtual environment\n```\npip3 install virtualenv\npython3 -m venv {your-venvname}\nsource {your-venvname}/bin/activate\n```\n\n- Install required libraries\n```\npip3 install -r requirements.txt\n```\n\n- Activate your virtual environment\n```\nsource {your-venvname}/bin/activate\n```\n\n3. Set up your `config.yaml` and `.env` file\nUpdate a `config.yaml` file in root folder [Refer](../example.config.yaml).\nCreate a `.env` file in root folder [Refer](../example.env)\n\n4. Installation and setup  \n```\nbash setup.sh\n```\n\n5. Running\n```\nstreamlit run app.py \n```\n\n## Contributing 🤝\nContributions to this project are welcome! If you find any issues or have suggestions for improvement, please open an issue or submit a pull request on the project's GitHub repository.\n\n## License 📝\nThis project is licensed under the [MIT License](https://github.com/SSK-14/WizSearch/blob/main/LICENSE). Feel free to use, modify, and distribute the code as per the terms of the license.\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FSSK-14%2FWizSearch","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FSSK-14%2FWizSearch","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FSSK-14%2FWizSearch/lists"}