{"id":28665503,"url":"https://github.com/lancedb/lance-research","last_synced_at":"2025-06-13T13:39:33.363Z","repository":{"id":279874753,"uuid":"731748203","full_name":"lancedb/lance-research","owner":"lancedb","description":"Research papers from Lance","archived":false,"fork":false,"pushed_at":"2025-02-27T23:29:19.000Z","size":4206,"stargazers_count":0,"open_issues_count":8,"forks_count":0,"subscribers_count":6,"default_branch":"main","last_synced_at":"2025-02-28T08:12:42.021Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Rust","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/lancedb.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-12-14T19:34:12.000Z","updated_at":"2025-02-27T23:29:22.000Z","dependencies_parsed_at":"2025-02-28T08:13:29.638Z","dependency_job_id":"51cc6680-170c-4e8a-ba53-f688e3ae6d52","html_url":"https://github.com/lancedb/lance-research","commit_stats":null,"previous_names":["lancedb/lance-research"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/lancedb/lance-research","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lancedb%2Flance-research","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lancedb%2Flance-research/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lancedb%2Flance-research/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lancedb%2Flance-research/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/lancedb","download_url":"https://codeload.github.com/lancedb/lance-research/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lancedb%2Flance-research/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":259654488,"owners_count":22891028,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-06-13T13:38:43.252Z","updated_at":"2025-06-13T13:39:33.330Z","avatar_url":"https://github.com/lancedb.png","language":"Rust","funding_links":[],"categories":[],"sub_categories":[],"readme":"# LanceDB Research\n\nThis repository contains papers, experiments, and other research performed by the LanceDB team.\nIt's intended to serve as a transparent and open source resource for the community to learn\nabout the work we're doing and also to reproduce our results.\n\n## Papers\n\n### Lance: Efficient Random Access in Columnar Storage through Adaptive Structural Encodings\n\nIn this paper we introduce the 2.1 version of the Lance file format. We explore random access\nperformance on NVMe storage for Lance, Parquet, as well as Arrow-style approaches (what we used\nin Lance 2.0). We justify the top-level structural encoding scheme for 2.1, demonstrate that we\nare able to make good use of NVMe storage, and identify areas for future work.\n\nWe also explore full scan performance and verify that 2.1 is able to achieve similar compression\nperformance to Parquet and meet or exceed Parquet's scan performance in most cases.\n\nContents for this paper are located in the `file_2_1` directory.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flancedb%2Flance-research","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Flancedb%2Flance-research","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flancedb%2Flance-research/lists"}