{"id":28493371,"url":"https://github.com/qdrant/qdrant-fluvio","last_synced_at":"2025-10-10T01:38:49.413Z","repository":{"id":254394899,"uuid":"846402696","full_name":"qdrant/qdrant-fluvio","owner":"qdrant","description":"Stream records from Fluvio topics to a Qdrant collection.","archived":false,"fork":false,"pushed_at":"2024-10-12T04:54:00.000Z","size":51,"stargazers_count":6,"open_issues_count":0,"forks_count":1,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-07-04T16:25:29.397Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"https://qdrant.tech/documentation/data-management/fluvio","language":"Rust","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/qdrant.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-08-23T06:10:37.000Z","updated_at":"2025-01-12T00:43:26.000Z","dependencies_parsed_at":"2024-09-08T05:25:40.908Z","dependency_job_id":null,"html_url":"https://github.com/qdrant/qdrant-fluvio","commit_stats":null,"previous_names":["anush008/qdrant-fluvio"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/qdrant/qdrant-fluvio","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/qdrant%2Fqdrant-fluvio","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/qdrant%2Fqdrant-fluvio/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/qdrant%2Fqdrant-fluvio/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/qdrant%2Fqdrant-fluvio/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/qdrant","download_url":"https://codeload.github.com/qdrant/qdrant-fluvio/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/qdrant%2Fqdrant-fluvio/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":264200734,"owners_count":23571827,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-06-08T09:08:34.368Z","updated_at":"2025-10-10T01:38:44.395Z","avatar_url":"https://github.com/qdrant.png","language":"Rust","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Fluvio Connector for Qdrant\n\nConnector to stream records from [Fluvio](https://www.fluvio.io/) topics to a Qdrant collection.\n\n## Downloading the connector\n\nRun the following commands after [setting up Fluvio](https://www.fluvio.io/docs/fluvio/quickstart).\n\n```\ncdk hub download qdrant/qdrant-sink@0.1.0\n```\n\n## Example Config\n\n\u003e _config.yml_\n\n```yaml\napiVersion: 0.1.0\nmeta:\n  version: 0.1.1\n  name: my-qdrant-connector\n  type: qdrant-sink\n  topic: some-topic\n  secrets:\n    - name: QDRANT_API_KEY\n\nqdrant:\n  url: https://xyz-example.eu-central.aws.cloud.qdrant.io:6334\n  api_key: \"${{ secrets.QDRANT_API_KEY }}\"\n```\n\n\u003e _secrets.txt_\n\n```text\nQDRANT_API_KEY=\u003cSOME_API_KEY\u003e\n```\n\n## Running\n\n```\ncdk deploy start --ipkg qdrant-qdrant-sink-0.1.0.ipkg -c config.yml --secrets secrets.txt\n```\n\n## Produce Messages\n\nYou can now run the following to generate messages to be written into Qdrant.\n\n```\nfluvio produce some-topic\n```\n\n## Message Formats\n\nThis sink connector supports messages with dense/sparse/multi vectors.\n\n_Click each to expand._\n\n\u003cdetails\u003e\n  \u003csummary\u003e\u003cb\u003eUnnamed/Default vector\u003c/b\u003e\u003c/summary\u003e\n\nReference: [Creating a collection with a default vector](https://qdrant.tech/documentation/concepts/collections/#create-a-collection).\n\n```json\n{\n    \"collection_name\": \"{collection_name}\",\n    \"id\": 1,\n    \"vectors\": [\n        0.1,\n        0.2,\n        0.3,\n        0.4,\n        0.5,\n        0.6,\n        0.7,\n        0.8\n    ],\n    \"payload\": {\n        \"name\": \"fluvio\",\n        \"description\": \"Solution for distributed stream processing\",\n        \"url\": \"https://www.fluvio.io/\"\n    }\n}\n```\n\n\u003c/details\u003e\n\n\u003cdetails\u003e\n  \u003csummary\u003e\u003cb\u003eNamed multiple vectors\u003c/b\u003e\u003c/summary\u003e\n\nReference: [Creating a collection with multiple vectors](https://qdrant.tech/documentation/concepts/collections/#collection-with-multiple-vectors).\n\n```json\n{\n    \"collection_name\": \"{collection_name}\",\n    \"id\": 1,\n    \"vectors\": {\n        \"some-dense\": [\n            0.1,\n            0.2,\n            0.3,\n            0.4,\n            0.5,\n            0.6,\n            0.7,\n            0.8\n        ],\n        \"some-other-dense\": [\n            0.1,\n            0.2,\n            0.3,\n            0.4,\n            0.5,\n            0.6,\n            0.7,\n            0.8\n        ]\n    },\n    \"payload\": {\n        \"name\": \"fluvio\",\n        \"description\": \"Solution for distributed stream processing\",\n        \"url\": \"https://www.fluvio.io/\"\n    }\n}\n```\n\n\u003c/details\u003e\n\n\u003cdetails\u003e\n  \u003csummary\u003e\u003cb\u003eSparse vectors\u003c/b\u003e\u003c/summary\u003e\n\nReference: [Creating a collection with sparse vectors](https://qdrant.tech/documentation/concepts/collections/#collection-with-sparse-vectors).\n\n```json\n{\n    \"collection_name\": \"{collection_name}\",\n    \"id\": 1,\n    \"vectors\": {\n        \"some-sparse\": {\n            \"indices\": [\n                0,\n                1,\n                2,\n                3,\n                4,\n                5,\n                6,\n                7,\n                8,\n                9\n            ],\n            \"values\": [\n                0.1,\n                0.2,\n                0.3,\n                0.4,\n                0.5,\n                0.6,\n                0.7,\n                0.8,\n                0.9,\n                1.0\n            ]\n        }\n    },\n    \"payload\": {\n        \"name\": \"fluvio\",\n        \"description\": \"Solution for distributed stream processing\",\n        \"url\": \"https://www.fluvio.io/\"\n    }\n}\n```\n\n\u003c/details\u003e\n\n\u003cdetails\u003e\n  \u003csummary\u003e\u003cb\u003eMulti-vector\u003c/b\u003e\u003c/summary\u003e\n\n```json\n{\n    \"collection_name\": \"{collection_name}\",\n    \"id\": 1,\n    \"vectors\": {\n        \"some-multi\": [\n            [\n                0.1,\n                0.2,\n                0.3,\n                0.4,\n                0.5,\n                0.6,\n                0.7,\n                0.8,\n                0.9,\n                1.0\n            ],\n            [\n                1.0,\n                0.9,\n                0.8,\n                0.5,\n                0.4,\n                0.8,\n                0.6,\n                0.4,\n                0.2,\n                0.1\n            ]\n        ]\n    },\n    \"payload\": {\n        \"name\": \"fluvio\",\n        \"description\": \"Solution for distributed stream processing\",\n        \"url\": \"https://www.fluvio.io/\"\n    }\n}\n```\n\n\u003c/details\u003e\n\n\u003cdetails\u003e\n  \u003csummary\u003e\u003cb\u003eCombination of named dense and sparse vectors\u003c/b\u003e\u003c/summary\u003e\n\nReference:\n\n- [Creating a collection with multiple vectors](https://qdrant.tech/documentation/concepts/collections/#collection-with-multiple-vectors).\n\n- [Creating a collection with sparse vectors](https://qdrant.tech/documentation/concepts/collections/#collection-with-sparse-vectors).\n\n```json\n{\n    \"collection_name\": \"{collection_name}\",\n    \"id\": \"a10435b5-2a58-427a-a3a0-a5d845b147b7\",\n    \"vectors\": {\n        \"some-other-dense\": [\n            0.1,\n            0.2,\n            0.3,\n            0.4,\n            0.5,\n            0.6,\n            0.7,\n            0.8\n        ],\n        \"some-sparse\": {\n            \"indices\": [\n                0,\n                1,\n                2,\n                3,\n                4,\n                5,\n                6,\n                7,\n                8,\n                9\n            ],\n            \"values\": [\n                0.1,\n                0.2,\n                0.3,\n                0.4,\n                0.5,\n                0.6,\n                0.7,\n                0.8,\n                0.9,\n                1.0\n            ]\n        }\n    },\n    \"payload\": {\n        \"name\": \"fluvio\",\n        \"description\": \"Solution for distributed stream processing\",\n        \"url\": \"https://www.fluvio.io/\"\n    }\n}\n```\n\n\u003c/details\u003e\n\n## LICENSE\n\nApache 2.0 © [2024](https://github.com/qdrant/qdrant-fluvio/blob/master/LICENSE)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fqdrant%2Fqdrant-fluvio","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fqdrant%2Fqdrant-fluvio","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fqdrant%2Fqdrant-fluvio/lists"}