{"id":13461741,"url":"https://github.com/quickwit-oss/quickwit","last_synced_at":"2026-01-29T11:31:18.394Z","repository":{"id":37072197,"uuid":"357707809","full_name":"quickwit-oss/quickwit","owner":"quickwit-oss","description":"Cloud-native search engine for observability. An open-source alternative to Datadog, Elasticsearch, Loki, and Tempo.","archived":false,"fork":false,"pushed_at":"2025-04-17T15:34:45.000Z","size":55263,"stargazers_count":9918,"open_issues_count":683,"forks_count":449,"subscribers_count":69,"default_branch":"main","last_synced_at":"2025-04-17T15:42:20.444Z","etag":null,"topics":["big-data","cloud-native","cloud-storage","distributed-tracing","log-management","logs","open-source","rust","search-engine","tantivy"],"latest_commit_sha":null,"homepage":"https://quickwit.io","language":"Rust","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/quickwit-oss.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":"SECURITY.md","support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2021-04-13T22:45:40.000Z","updated_at":"2025-04-17T15:34:48.000Z","dependencies_parsed_at":"2023-10-03T02:21:44.249Z","dependency_job_id":"113735b3-892c-4294-b182-d5304b6e5506","html_url":"https://github.com/quickwit-oss/quickwit","commit_stats":{"total_commits":2531,"total_committers":68,"mean_commits":"37.220588235294116","dds":0.7597787435796128,"last_synced_commit":"be6ec44185afe7c0f5256766baa0dfe6258397e6"},"previous_names":["quickwit-inc/quickwit"],"tags_count":246,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quickwit-oss%2Fquickwit","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quickwit-oss%2Fquickwit/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quickwit-oss%2Fquickwit/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/quickwit-oss%2Fquickwit/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/quickwit-oss","download_url":"https://codeload.github.com/quickwit-oss/quickwit/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":251207130,"owners_count":21552516,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["big-data","cloud-native","cloud-storage","distributed-tracing","log-management","logs","open-source","rust","search-engine","tantivy"],"created_at":"2024-07-31T11:00:55.645Z","updated_at":"2026-01-29T11:31:18.381Z","avatar_url":"https://github.com/quickwit-oss.png","language":"Rust","readme":"[![CI](https://github.com/quickwit-oss/quickwit/actions/workflows/ci.yml/badge.svg)](https://github.com/quickwit-oss/quickwit/actions?query=workflow%3ACI+branch%3Amain)\n[![codecov](https://codecov.io/gh/quickwit-oss/quickwit/branch/main/graph/badge.svg?token=06SRGAV5SS)](https://codecov.io/gh/quickwit-oss/quickwit)\n[![OpenSSF Scorecard](https://api.scorecard.dev/projects/github.com/quickwit-oss/quickwit/badge)](https://scorecard.dev/viewer/?uri=github.com/quickwit-oss/quickwit)\n[![Contributor Covenant](https://img.shields.io/badge/Contributor%20Covenant-2.0-4baaaa.svg)](CODE_OF_CONDUCT.md)\n[![License: Apache 2.0](https://img.shields.io/badge/license-Apache%202.0-blue?style=flat-square)](LICENSE)\n[![Twitter Follow](https://img.shields.io/twitter/follow/Quickwit_Inc?color=%231DA1F2\u0026logo=Twitter\u0026style=plastic)](https://twitter.com/Quickwit_Inc)\n[![Discord](https://img.shields.io/discord/908281611840282624?logo=Discord\u0026logoColor=%23FFFFFF\u0026style=plastic)](https://discord.quickwit.io)\n\u003cbr/\u003e\n\n\u003cbr/\u003e\n\u003cbr/\u003e\n\u003cp align=\"center\"\u003e\n  \u003cimg src=\"docs/assets/images/logo_horizontal.svg#gh-light-mode-only\" alt=\"Quickwit Cloud-Native Search Engine\" height=\"40\"\u003e\n  \u003cimg src=\"docs/assets/images/quickwit-dark-theme-logo.png#gh-dark-mode-only\" alt=\"Quickwit Cloud-Native Search Engine\" height=\"40\"\u003e\n\u003c/p\u003e\n\n\u003ch2 align=\"center\"\u003e\nCloud-native search engine for observability (logs, traces, and soon metrics!). An open-source alternative to Datadog, Elasticsearch,  Loki, and Tempo.\n\u003c/h2\u003e\n\n\u003ch4 align=\"center\"\u003e\n  \u003ca href=\"https://quickwit.io/docs/get-started/quickstart\"\u003eQuickstart\u003c/a\u003e |\n  \u003ca href=\"https://quickwit.io/docs/\"\u003eDocs\u003c/a\u003e |\n  \u003ca href=\"https://quickwit.io/tutorials\"\u003eTutorials\u003c/a\u003e |\n  \u003ca href=\"https://discord.quickwit.io\"\u003eChat\u003c/a\u003e |\n  \u003ca href=\"https://quickwit.io/docs/get-started/installation\"\u003eDownload\u003c/a\u003e\n\u003c/h4\u003e\n\u003cbr/\u003e\n\n\u003cb\u003eWe just released Quickwit 0.8! Read the [blog post](https://quickwit.io/blog/quickwit-0.8) to learn about the latest powerful features!\u003c/b\u003e\n\n### **Quickwit is the fastest search engine on cloud storage. It's the perfect fit for observability use cases**\n\n- [Log management](https://quickwit.io/docs/log-management/overview)\n- [Distributed tracing](https://quickwit.io/docs/distributed-tracing/overview)\n- Metrics support is on the roadmap\n\n### 🚀 Quickstart\n\n- [Search and analytics on Stack Overflow dataset](https://quickwit.io/docs/get-started/quickstart)\n- [Trace analytics with Grafana](https://quickwit.io/docs/get-started/tutorials/trace-analytics-with-grafana)\n- [Distributed tracing with Jaeger](https://quickwit.io/docs/get-started/tutorials/tutorial-jaeger)\n\n\u003cbr/\u003e\n\n\u003cvideo src=\"https://github.com/quickwit-oss/quickwit/assets/653704/020b94b9-deeb-4376-9a3a-b82e1168094c\" controls=\"controls\" style=\"max-width: 1200px;\"\u003e\n\u003c/video\u003e\n\n\u003cbr/\u003e\n\n# 💡 Features\n\n- Full-text search and aggregation queries\n- Elasticsearch-compatible API, use Quickwit with any Elasticsearch or OpenSearch client\n- [Jaeger-native](https://quickwit.io/docs/distributed-tracing/plug-quickwit-to-jaeger)\n- OTEL-native for [logs](https://quickwit.io/docs/log-management/overview) and [traces](https://quickwit.io/docs/distributed-tracing/overview)\n- [Schemaless](https://quickwit.io/docs/guides/schemaless) or strict schema indexing\n- Schemaless analytics\n- Sub-second search on cloud storage (Amazon S3, Azure Blob Storage, Google Cloud Storage, …)\n- Decoupled compute and storage, stateless indexers \u0026 searchers\n- [Grafana data source](https://github.com/quickwit-oss/quickwit-datasource)\n- Kubernetes ready - See our [helm-chart](https://quickwit.io/docs/deployment/kubernetes/helm)\n- RESTful API\n\n## Enterprise ready\n\n- Multiple [data sources](https://quickwit.io/docs/ingest-data/) Kafka / Kinesis / Pulsar native\n- Multi-tenancy: indexing with many indexes and partitioning\n- Retention policies\n- Delete tasks (for GDPR use cases)\n- Distributed and highly available* engine that scales out in seconds (*HA indexing only with Kafka)\n\n# 📑 Architecture overview\n\n![Quickwit Distributed Tracing](./docs/assets/images/quickwit-overview-light.svg#gh-light-mode-only)![Quickwit Distributed Tracing](./docs/assets/images/quickwit-overview-dark.svg#gh-dark-mode-only)\n\n- [Architecture overview]([https://quickwit.io/docs/distributed-tracing/overview](https://quickwit.io/docs/overview/architecture))\n- [Log management](https://quickwit.io/docs/log-management/overview)\n- [Distributed traces](https://quickwit.io/docs/distributed-tracing/overview)\n\n\n# 📕 Documentation\n\n- [Installation](https://quickwit.io/docs/get-started/installation)\n- [Log management with Quickwit](https://quickwit.io/docs/log-management/overview)\n- [Distributed Tracing with Quickwit](https://quickwit.io/docs/distributed-tracing/overview)\n- [Ingest data](https://quickwit.io/docs/ingest-data/)\n- [REST API](https://quickwit.io/docs/reference/rest-api)\n\n# 📚 Resources\n\n- [Blog posts](https://quickwit.io/blog/)\n- [Youtube channel](https://www.youtube.com/@quickwit8103)\n- [Discord](https://discord.quickwit.io)\n\n# 🔮 Roadmap\n\n- Quickwit 0.9 (July 2024)\n  - Indexing and search performance improvements\n  - Index configuration updates (retention policy, indexing and search settings)\n  - Concatenated field\n\n- Quickwit 0.10 (October 2024)\n  - Schema (doc mapping) updates\n  - Native distributed ingestion\n  - Index templates\n\n# 🙋 FAQ\n\n### How can I switch from Elasticsearch or OpenSearch to Quickwit?\n\nQuickwit supports a large subset of Elasticsearch/OpenSearch API.\n\nFor instance, it has an ES-compatible ingest API to make it easier to migrate your log shippers (Vector, Fluent Bit, Syslog, ...) to Quickwit.\n\nOn the search side, the most popular Elasticsearch endpoints, query DSL, and even aggregations are supported.\n\nThe list of available endpoints and queries is available [here](https://quickwit.io/docs/reference/es_compatible_api), while the list of supported aggregations is available [here](https://quickwit.io/docs/reference/aggregation).\n\nLet us know if part of the API you are using is missing!\n\nIf the client you are using is refusing to connect to Quickwit due to missing headers, you can use the `extra_headers` option in the [node configuration](https://quickwit.io/docs/configuration/node-config#rest-configuration) to impersonate any compatible version of Elasticsearch or OpenSearch.\n\n### How is Quickwit different from traditional search engines like Elasticsearch or Solr?\n\nThe core difference and advantage of Quickwit is its architecture built from the ground to search on cloud storage. We optimized IO paths, revamped the index data structures and made search stateless and sub-second on cloud storage.\n\n### How does Quickwit compare to Elastic in terms of cost?\n\nWe estimate that Quickwit can be up to 10x cheaper on average than Elastic. To understand how, check out our [blog post](https://quickwit.io/blog/commoncrawl/) about searching the web on AWS S3.\n\n### What license does Quickwit use?\n\nQuickwit is open-source under the Apache License, Version 2.0 - Apache-2.0.\n\n### Is it possible to set up Quickwit for a High Availability (HA)?\n\nHA is available for search, for indexing it's available only with a Kafka source.\n\n# 🤝 Contribute and spread the word\n\nWe are always thrilled to receive contributions: code, documentation, issues, or feedback. Here's how you can help us build the future of log management:\n\n- Start by checking out the [GitHub issues labeled \"Good first issue\"](https://github.com/quickwit-oss/quickwit/issues?q=is%3Aissue+is%3Aopen+label%3A%22good+first+issue%22). These are a great place for newcomers to contribute.\n- Read our [Contributor Covenant Code of Conduct](./CODE_OF_CONDUCT.md) to understand our community standards.\n- [Create a fork of Quickwit](https://github.com/quickwit-oss/quickwit/fork) to have your own copy of the repository where you can make changes.\n- To understand how to contribute, read our [contributing guide](./CONTRIBUTING.md).\n- Set up your development environment following our [development setup guide](./CONTRIBUTING.md#development).\n- Once you've made your changes and tested them, you can contribute by [submitting a pull request](./CONTRIBUTING.md#submitting-a-pr).\n\n✨ After your contributions are accepted, don't forget to claim your swag by emailing us at hello@quickwit.io. Thank you for contributing!\n\n# 💬 Join Our Community\n\nWe welcome everyone to our community! Whether you're contributing code or just saying hello, we'd love to hear from you. Here's how you can connect with us:\n\n- Join the conversation on [Discord](https://discord.quickwit.io).\n- Follow us on [Twitter](https://twitter.com/Quickwit_Inc).\n- Check out our [website](https://quickwit.io/) and [blog](https://quickwit.io/blog) for the latest updates.\n- Watch our [YouTube](https://www.youtube.com/channel/UCvZVuRm2FiDq1_ul0mY85wA) channel for video content.\n","funding_links":[],"categories":["Rust","Applications","rust","应用程序 Applications","big-data","📋 Contents","💻 Development","\u003ca name=\"Rust\"\u003e\u003c/a\u003eRust","Logging","Databases / Log management"],"sub_categories":["Observability","可观察性 Observability","🔍 5. Retrieval-Augmented Generation (RAG) \u0026 Knowledge","☸️ Kubernetes","Screen Sharing"],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fquickwit-oss%2Fquickwit","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fquickwit-oss%2Fquickwit","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fquickwit-oss%2Fquickwit/lists"}