{"id":21090576,"url":"https://github.com/mdarshad1000/vectorlite","last_synced_at":"2026-04-28T14:33:51.330Z","repository":{"id":261020769,"uuid":"882859367","full_name":"mdarshad1000/VectorLite","owner":"mdarshad1000","description":"VectorLite is a lightweight, easy-to-use, vector database with various indexing techniques. Primarily built to study how vector DBs work and how they can be used in practice.","archived":false,"fork":false,"pushed_at":"2024-12-03T07:04:08.000Z","size":45,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-03-09T15:39:04.778Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/mdarshad1000.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-11-03T23:36:34.000Z","updated_at":"2024-12-03T07:04:12.000Z","dependencies_parsed_at":"2024-11-04T09:21:43.611Z","dependency_job_id":"5925394f-d992-4fed-971e-13bb715928e8","html_url":"https://github.com/mdarshad1000/VectorLite","commit_stats":null,"previous_names":["mdarshad1000/vectorlite"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mdarshad1000%2FVectorLite","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mdarshad1000%2FVectorLite/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mdarshad1000%2FVectorLite/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mdarshad1000%2FVectorLite/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/mdarshad1000","download_url":"https://codeload.github.com/mdarshad1000/VectorLite/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243532556,"owners_count":20306157,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-19T21:38:15.278Z","updated_at":"2025-12-29T14:45:07.003Z","avatar_url":"https://github.com/mdarshad1000.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003e This is a work in progress.\n\n# VectorLite\nVectorLite is a lightweight, easy-to-use, and scalable vector database. It's primarily built to explore the workings of vector databases and their practical applications.\n\n\u003cdiv align=\"center\"\u003e\n  \u003cimg src=\"https://drive.google.com/uc?export=view\u0026id=11wRls96Y5Fr8_81JQVd6iUw7fRIfqR5g\" alt=\"Alt Text\" width=\"25%\"\u003e\n\u003c/div\u003e\n\n## Components of VectorLite \n\n1. **Database**: The core container for tables and indexes.\n2. **Table**: Stores and manages vectors and their metadata.\n3. **Index**: Facilitates efficient vector search.\n   - **Types of Indexes**:\n     - Flat (Brute Force)\n     - IVF (Inverted File Index)\n     - HNSW (Hierarchical Navigable Small World)\n     - PQ (Product Quantization)\n     - SQ (Scalar Quantization)\n\n4. **Embedder**: Converts text to vectors using various models.\n   - Sentence Transformer\n   - OpenAI Embeddings\n   - Cohere\n\n### Methods in Index Class\n1. **Construct the Index**: Initializes a new index.\n2. **Search Vectors in the Index**: Retrieves vectors closest to the query vector.\n\n### Methods in Table Class\n1. **Initialise the Table**: Sets up a new table for storing vectors.\n2. **Add Vectors to the Table**: Inserts new vectors into the table.\n3. **Search Vectors in the Table**: Finds vectors within the table based on a query.\n4. **Query the Index**: Searches the index using table data.\n5. **Delete Vectors from the Table**: Removes vectors from the table.\n\n### TODO:\n- [x] Implement Flat Index\n- [x] Implement IVF Index\n- [x] Implement HNSW Index\n- [ ] Implement PQ Index\n- [ ] Implement SQ Index\n- [ ] **Persist to Disk**: Implement serialization and deserialization for data persistence.\n- [ ] **Add Metadata Filtering**: Allow filtering search results based on metadata.\n- [ ] **Search Across Multiple Tables**: Introduce join functionality for querying multiple tables.","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmdarshad1000%2Fvectorlite","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmdarshad1000%2Fvectorlite","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmdarshad1000%2Fvectorlite/lists"}