{"id":18565674,"url":"https://github.com/quiltdata/quilt-renovate","last_synced_at":"2025-09-06T01:44:11.246Z","repository":{"id":36397609,"uuid":"223812981","full_name":"quiltdata/quilt-renovate","owner":"quiltdata","description":"Destination for renovate PRs to keep PR volume down","archived":false,"fork":false,"pushed_at":"2022-12-08T06:56:28.000Z","size":46089,"stargazers_count":0,"open_issues_count":42,"forks_count":0,"subscribers_count":5,"default_branch":"master","last_synced_at":"2025-05-15T19:09:27.961Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/quiltdata.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"docs/CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":"docs/CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2019-11-24T21:29:54.000Z","updated_at":"2019-11-26T05:59:53.000Z","dependencies_parsed_at":"2023-01-17T01:32:10.414Z","dependency_job_id":null,"html_url":"https://github.com/quiltdata/quilt-renovate","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/quiltdata/quilt-renovate","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quiltdata%2Fquilt-renovate","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quiltdata%2Fquilt-renovate/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quiltdata%2Fquilt-renovate/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quiltdata%2Fquilt-renovate/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/quiltdata","download_url":"https://codeload.github.com/quiltdata/quilt-renovate/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quiltdata%2Fquilt-renovate/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":265637096,"owners_count":23802638,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-06T22:19:41.574Z","updated_at":"2025-07-17T17:37:28.305Z","avatar_url":"https://github.com/quiltdata.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003c!--\n\tAre you editing this file?\n\t* /README.md and docs/README.md should be identical copies (symlinks don't work)\n\t* Use only *absolute links* in these files. Relative links will break.\n!--\u003e\n[![docs on_gitbook](https://img.shields.io/badge/docs-on_gitbook-blue.svg?style=flat-square)](https://docs.quiltdata.com/)\n[![chat on_slack](https://img.shields.io/badge/chat-on_slack-blue.svg?style=flat-square)](https://slack.quiltdata.com/)\n[![codecov](https://codecov.io/gh/quiltdata/quilt/branch/master/graph/badge.svg)](https://codecov.io/gh/quiltdata/quilt)\n[![pypi](https://img.shields.io/pypi/v/quilt3.svg?style=flat-square)](https://pypi.org/project/quilt3/)\n\n\u003e Below is the documentation for [Quilt 3](https://quiltdata.com/). See [here](https://docs.quiltdata.com/v/quilt-2-master/) and [here](https://github.com/quiltdata/quilt/tree/quilt-2-master) from Quilt 2.\n\n# Quilt is a versioned data portal for AWS\n\n* [open.quiltdata.com](https://open.quiltdata.com/) is a petabyte-scale open data portal that runs on Quilt\n* [quiltdata.com](https://quiltdata.com) includes case studies, use cases, videos, and information on how you can run a private Quilt instance\n\n\n## Who is Quilt for?\nQuilt is for data-driven teams of both technical\nand non-technical members (executives, data scientists,\ndata engineers, sales, product, etc.).\n\n## What does Quilt do?\nQuilt adds search, visual content preview, and\nversioning to every file in S3.\n\n## How does Quilt work?\nQuilt consists of a Python client, web catalog, lambda\nfunctions\u0026mdash;all of which are open source\u0026mdash;plus\na suite of backend services and Docker containers\norchestrated by CloudFormation.\nThe latter are available under a paid license for\nprivate use on [quiltdata.com](https://quiltdata.com).\n\n\n## Use cases\n\nQuilt addresses five key use cases:\n* **Share** data at scale. Quilt wraps AWS S3 to add simple URLs, web preview for large files, and sharing via email address (no need to create an IAM role).\n* **Understand** data better through inline documentation (Jupyter notebooks, markdown) and visualizations (Vega, Vega Lite)\n* **Discover** related data by indexing objects in ElasticSearch\n* **Model** data by providing a home for large data and models that don't fit in git, and by providing immutable versions for objects and data sets (a.k.a. \"Quilt Packages\")\n* **Decide** by broadening data access within the organization and supporting the documentation of decision processes through audit-able versioning and inline documentation\n\n## Roadmap\n\n### I - Performance and core services\n* [ ] Address performance issues with push (e.g. re-hash)\n* [ ] Refactor `s3://bucket/.quilt` for improved listing and delete performance\n* [ ] Metadata services for filtering packages\n\n### II - CI/CD for data\n* [ ] Ability to fork/merge packages\n* [ ] Data quality monitoring\n\n### III - Storage agnostic (support Azure, GCP buckets)\n* [ ] Evaluate min.io and ceph.io\n* [ ] Evaluate feasibility of local storage (e.g. NAS)\n\n### IV - Cloud agnostic\n* [ ] K8s deployment for Azure, GCP\n* [ ] Shim lambdas (consider serverless.com)\n* [ ] Shim ElasticSearch (consider SOLR)\n* [ ] Shim IAM via RBAC\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fquiltdata%2Fquilt-renovate","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fquiltdata%2Fquilt-renovate","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fquiltdata%2Fquilt-renovate/lists"}