{"id":18077360,"url":"https://github.com/parisneo/lollmsvectordb","last_synced_at":"2025-04-12T09:31:09.339Z","repository":{"id":243425988,"uuid":"812393796","full_name":"ParisNeo/LoLLMsVectorDB","owner":"ParisNeo","description":"A modular text-based database manager for retrieval-augmented generation (RAG), seamlessly integrating with the LoLLMs ecosystem. Supports various vectorization methods and directory bindings for efficient text data management.","archived":false,"fork":false,"pushed_at":"2025-02-10T00:30:13.000Z","size":115,"stargazers_count":11,"open_issues_count":0,"forks_count":1,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-04-10T17:06:01.318Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ParisNeo.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-06-08T19:02:29.000Z","updated_at":"2025-03-07T12:47:48.000Z","dependencies_parsed_at":"2024-10-31T11:25:46.135Z","dependency_job_id":"23ddcd3c-a706-4779-9a7d-52681db8be6a","html_url":"https://github.com/ParisNeo/LoLLMsVectorDB","commit_stats":{"total_commits":39,"total_committers":1,"mean_commits":39.0,"dds":0.0,"last_synced_commit":"62e08fc32b8455c6da948b91d7bf3d1e6002bda0"},"previous_names":["parisneo/lollmsvectordb"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ParisNeo%2FLoLLMsVectorDB","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ParisNeo%2FLoLLMsVectorDB/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ParisNeo%2FLoLLMsVectorDB/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ParisNeo%2FLoLLMsVectorDB/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ParisNeo","download_url":"https://codeload.github.com/ParisNeo/LoLLMsVectorDB/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248546014,"owners_count":21122245,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-31T11:24:23.237Z","updated_at":"2025-04-12T09:31:09.077Z","avatar_url":"https://github.com/ParisNeo.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# LoLLMsVectorDB\n\n**LoLLMsVectorDB**: A modular text-based database manager for retrieval-augmented generation (RAG), seamlessly integrating with the LoLLMs ecosystem. Supports various vectorization methods and directory bindings for efficient text data management.\n\n## Features\n\n- **Flexible Vectorization**: Supports multiple vectorization methods including TF-IDF and Word2Vec.\n- **Directory Binding**: Automatically updates the vector store with text data from a specified directory.\n- **Efficient Search**: Provides fast and accurate search results with metadata to locate the original text chunks.\n- **Modular Design**: Easily extendable to support new vectorization methods and functionalities.\n\n## Installation\n\n```bash\npip install lollmsvectordb\n```\n\n## Usage\n\n### Example with TFIDFVectorizer\n\n```python\nfrom lollmsvectordb import TFIDFVectorizer, VectorDatabase, DirectoryBinding\n\n# Initialize the vectorizer\ntfidf_vectorizer = TFIDFVectorizer()\ntfidf_vectorizer.fit([\"This is a sample text.\", \"Another sample text.\"])\n\n# Create the vector database\ndb = VectorDatabase(\"vector_db.sqlite\", tfidf_vectorizer)\n\n# Bind a directory to the vector database\ndirectory_binding = DirectoryBinding(\"path_to_your_directory\", db)\n\n# Update the vector store with text data from the directory\ndirectory_binding.update_vector_store()\n\n# Search for a query in the vector database\nresults = directory_binding.search(\"This is a sample text.\")\nprint(results)\n```\n\n### Adding New Vectorization Methods\n\nTo add a new vectorization method, create a subclass of the `Vectorizer` class and implement the `vectorize` method.\n\n```python\nfrom lollmsvectordb import Vectorizer\n\nclass CustomVectorizer(Vectorizer):\n    def vectorize(self, data):\n        # Implement your custom vectorization logic here\n        pass\n```\n\n## Contributing\n\nContributions are welcome! Please fork the repository and submit a pull request.\n\n## License\n\nThis project is licensed under the MIT License.\n\n## Contact\n\nFor any questions or suggestions, feel free to reach out to the author:\n\n- **Twitter**: [@ParisNeo_AI](https://twitter.com/ParisNeo_AI)\n- **Discord**: [Join our Discord](https://discord.gg/BDxacQmv)\n- **Sub-Reddit**: [r/lollms](https://www.reddit.com/r/lollms/)\n- **Instagram**: [spacenerduino](https://www.instagram.com/spacenerduino/)\n\n## Acknowledgements\n\nSpecial thanks to the LoLLMs community for their continuous support and contributions.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fparisneo%2Flollmsvectordb","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fparisneo%2Flollmsvectordb","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fparisneo%2Flollmsvectordb/lists"}