{"id":18395824,"url":"https://github.com/deepset-ai/haystack-experimental","last_synced_at":"2026-02-05T10:12:58.846Z","repository":{"id":239724414,"uuid":"798287987","full_name":"deepset-ai/haystack-experimental","owner":"deepset-ai","description":"🧪 Experimental features for Haystack","archived":false,"fork":false,"pushed_at":"2026-01-20T13:26:35.000Z","size":8032,"stargazers_count":58,"open_issues_count":7,"forks_count":23,"subscribers_count":6,"default_branch":"main","last_synced_at":"2026-01-20T22:06:28.461Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"https://haystack.deepset.ai","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/deepset-ai.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":".github/CODEOWNERS","security":"SECURITY.md","support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2024-05-09T13:30:39.000Z","updated_at":"2026-01-09T09:55:34.000Z","dependencies_parsed_at":"2024-05-14T09:30:49.045Z","dependency_job_id":"7fec3500-7992-4517-a62c-7bbae331fe52","html_url":"https://github.com/deepset-ai/haystack-experimental","commit_stats":{"total_commits":120,"total_committers":14,"mean_commits":8.571428571428571,"dds":0.7583333333333333,"last_synced_commit":"41903c17bad406a2600c46edc0f0bf3d2af3b3ac"},"previous_names":["deepset-ai/haystack-experimental"],"tags_count":22,"template":false,"template_full_name":null,"purl":"pkg:github/deepset-ai/haystack-experimental","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/deepset-ai%2Fhaystack-experimental","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/deepset-ai%2Fhaystack-experimental/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/deepset-ai%2Fhaystack-experimental/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/deepset-ai%2Fhaystack-experimental/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/deepset-ai","download_url":"https://codeload.github.com/deepset-ai/haystack-experimental/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/deepset-ai%2Fhaystack-experimental/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29119228,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-02-05T09:40:36.738Z","status":"ssl_error","status_checked_at":"2026-02-05T09:36:49.977Z","response_time":65,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-06T02:12:01.155Z","updated_at":"2026-02-05T10:12:58.840Z","avatar_url":"https://github.com/deepset-ai.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"[![PyPI - Version](https://img.shields.io/pypi/v/haystack-experimental.svg)](https://pypi.org/project/haystack-experimental)\n[![PyPI - Python Version](https://img.shields.io/pypi/pyversions/haystack-experimental.svg)](https://pypi.org/project/haystack-experimental)\n[![Tests](https://github.com/deepset-ai/haystack-experimental/actions/workflows/tests.yml/badge.svg)](https://github.com/deepset-ai/haystack-experimental/actions/workflows/tests.yml)\n[![Project release on PyPi](https://github.com/deepset-ai/haystack-experimental/actions/workflows/pypi_release.yml/badge.svg)](https://github.com/deepset-ai/haystack-experimental/actions/workflows/pypi_release.yml)\n[![Hatch project](https://img.shields.io/badge/%F0%9F%A5%9A-Hatch-4051b5.svg)](https://github.com/pypa/hatch)\n[![Checked with mypy](https://www.mypy-lang.org/static/mypy_badge.svg)](https://mypy-lang.org/)\n\n# Haystack experimental package\n\nThe `haystack-experimental` package provides Haystack users with access to experimental features without immediately\ncommitting to their official release. The main goal is to gather user feedback and iterate on new features quickly.\n\n## Installation\n\nFor simplicity, every release of `haystack-experimental` will ship all the available experiments at that time. To\ninstall the latest experimental features, run:\n\n```sh\n$ pip install -U haystack-experimental\n```\n\nInstall from the `main` branch to try the newest features:\n```sh\npip install git+https://github.com/deepset-ai/haystack-experimental.git@main\n```\n\n\u003e [!IMPORTANT]\n\u003e The latest version of the experimental package is only tested against the latest version of Haystack. Compatibility\n\u003e with older versions of Haystack is not guaranteed.\n\n## Experiments lifecycle\n\nEach experimental feature has a default lifespan of 3 months starting from the date of the first non-pre-release build\nthat includes it. Once it reaches the end of its lifespan, the experiment will be either:\n\n- Merged into Haystack core and published in the next minor release, or\n- Released as a Core Integration, or\n- Dropped.\n\n## Experiments catalog\n\n### Active experiments\n\n| Name                                                                                   | Type                                  | Expected End Date | Dependencies | Cookbook                                                                                                                                                                                                                                                   | Discussion    |\n|----------------------------------------------------------------------------------------|---------------------------------------|-------------------|--------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|---------------|\n| [`OpenAIChatGenerator`][9]                                                             | Chat Generator Component              | November 2025     | None         | \u003ca href=\"https://colab.research.google.com/github/deepset-ai/haystack-cookbook/blob/main/notebooks/hallucination_score_calculator.ipynb\" target=\"_parent\"\u003e\u003cimg src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/\u003e        | [Discuss][10] |\n| [`MarkdownHeaderLevelInferrer`][15]                                                    | Preprocessor                          | January 2025      | None         | None                                                                                                                                                                                                                                                       | [Discuss][16] |\n| [`Agent`][17]; [`BreakpointConfirmationStrategy`][20]; [`HITLBreakpointException`][22] | Human in the Loop via Breakpoints     | December 2025     | None         | None                                                                                                                                                                                                                                                       | [Discuss][23] |\n| [`LLMSummarizer`][24]                                                                  | Document Summarizer                   | January 2025      | None         | None                                                                                                                                                                                                                                                       | [Discuss][25] |\n| [`InMemoryChatMessageStore`][1]; [`ChatMessageRetriever`][2]; [`ChatMessageWriter`][3] | Chat Message Store, Retriever, Writer | February 2025     | None         | \u003ca href=\"https://colab.research.google.com/github/deepset-ai/haystack-cookbook/blob/main/notebooks/conversational_rag_using_memory.ipynb\" target=\"_parent\"\u003e\u003cimg src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/\u003e       | [Discuss][4]  |\n| [`Mem0MemoryStore`][26]                                                                | MemoryStore                           | April 2025        | mem0ai       | None                                                                                                                                                                                                                                                       | --            |\n\n[1]: https://github.com/deepset-ai/haystack-experimental/blob/main/haystack_experimental/chat_message_stores/in_memory.py\n[2]: https://github.com/deepset-ai/haystack-experimental/blob/main/haystack_experimental/components/retrievers/chat_message_retriever.py\n[3]: https://github.com/deepset-ai/haystack-experimental/blob/main/haystack_experimental/components/writers/chat_message_writer.py\n[4]: https://github.com/deepset-ai/haystack-experimental/discussions/75\n[9]: https://github.com/deepset-ai/haystack-experimental/blob/main/haystack_experimental/components/generators/chat/openai.py\n[10]: https://github.com/deepset-ai/haystack-experimental/discussions/361\n[15]: https://github.com/deepset-ai/haystack-experimental/blob/main/haystack_experimental/components/preprocessors/md_header_level_inferrer.py  \n[16]: https://github.com/deepset-ai/haystack-experimental/discussions/376\n[17]: https://github.com/deepset-ai/haystack-experimental/blob/main/haystack_experimental/components/agents/agent.py\n[20]: https://github.com/deepset-ai/haystack-experimental/blob/main/haystack_experimental/components/agents/human_in_the_loop/strategies.py\n[22]: https://github.com/deepset-ai/haystack-experimental/blob/main/haystack_experimental/components/agents/human_in_the_loop/errors.py\n[23]: https://github.com/deepset-ai/haystack-experimental/discussions/381\n[24]: https://github.com/deepset-ai/haystack-experimental/blob/main/haystack_experimental/components/sumarizers/llm_summarizer.py\n[25]: https://github.com/deepset-ai/haystack-experimental/discussions/382\n[26]: https://github.com/deepset-ai/haystack-experimental/blob/main/haystack_experimental/memory_stores/mem0/memory_store.py\n\n### Adopted experiments\n| Name                                                                                                                                                                                                                                       | Type                                      | Final release |\n|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|-------------------------------------------|---------------|\n| `ChatMessage` refactoring; `Tool` class; tool support in ChatGenerators; `ToolInvoker`                                                                                                                                                     | Tool Calling support                      | 0.4.0         |\n| `AsyncPipeline`; `Pipeline` bug fixes and refactoring                                                                                                                                                                                      | AsyncPipeline execution                   | 0.7.0         |\n| `LLMMetadataExtractor`                                                                                                                                                                                                                     | Metadata extraction with LLM              | 0.7.0         |\n| `Auto-Merging Retriever` \u0026 `HierarchicalDocumentSplitter`                                                                                                                                                                                  | Document Splitting \u0026 Retrieval Technique  | 0.8.0         |\n| `Agent`                                                                                                                                                                                                                                    | Simplify Agent development                | 0.8.0         |\n| `SuperComponent`                                                                                                                                                                                                                           | Simplify Pipeline development             | 0.8.0         |\n| `Pipeline`                                                                                                                                                                                                                                 | Pipeline breakpoints for debugging        | 0.12.0        |\n| `ImageContent`; Image Converters; multimodal support in `OpenAIChatGenerator` and `AmazonBedrockChatGenerator`; `ChatPromptBuilder` refactoring; `SentenceTransformersDocumentImageEmbedder`; `LLMDocumentContentExtractor`; new `Routers` | Multimodality                             | 0.12.0        |\n| `QueryExpander`                                                                                                                                                                                                                            | Query Expansion Component                 | 0.14.3        |\n| `MultiQueryEmbeddingRetriever`                                                                                                                                                                                                             | MultiQueryEmbeddingRetriever              | 0.14.3        |\n| `MultiQueryTextRetriever`                                                                                                                                                                                                                  | MultiQueryTextRetriever                   | 0.14.3        |\n| `EmbeddingBasedDocumentSplitter`                                                                                                                                                                                                           | Document Splitting                        | 0.15.2        |\n| `Confirmation Policies`; `ConfirmationUIs`; `BlockingConfirmationStrategy`; `ConfirmationUIResult`; `ToolExecutionDecision`                                                                                                                | Human in the Loop                         | 0.16.0        |\n\n### Discontinued experiments\n\n| Name                   | Type                       | Final release | Cookbook                                                                                                                                 |\n|------------------------|----------------------------|---------------|------------------------------------------------------------------------------------------------------------------------------------------|\n| `OpenAIFunctionCaller` | Function Calling Component | 0.3.0         | None                                                                                                                                     |\n| `OpenAPITool`          | OpenAPITool component      | 0.3.0         | [Notebook](https://github.com/deepset-ai/haystack-experimental/blob/fe20b69b31243f8a3976e4661d9aa8c88a2847d2/examples/openapitool.ipynb) |\n| `EvaluationHarness`    | Evaluation orchestrator    | 0.7.0         | None                                                                                                                                     |\n\n## Usage\n\nExperimental new features can be imported like any other Haystack integration package:\n\n```python\nfrom haystack.dataclasses import ChatMessage\nfrom haystack_experimental.components.generators import FoobarGenerator\n\nc = FoobarGenerator()\nc.run([ChatMessage.from_user(\"What's an experiment? Be brief.\")])\n```\n\nExperiments can also override existing Haystack features. For example, users can opt into an experimental type of\n`Pipeline` by just changing the usual import:\n\n```python\n# from haystack import Pipeline\nfrom haystack_experimental import Pipeline\n\npipe = Pipeline()\n# ...\npipe.run(...)\n```\n\nSome experimental features come with example notebooks that can be found in the [Haystack Cookbook](https://haystack.deepset.ai/cookbook).\n\n## Documentation\n\nDocumentation for `haystack-experimental` can be found [here](https://docs.haystack.deepset.ai/reference/experimental-data-classes-api).\n\n## Implementation\n\nExperiments should replicate the namespace of the core package. For example, a new generator:\n\n```python\n# in haystack_experimental/components/generators/foobar.py\n\nfrom haystack import component\n\n\n@component\nclass FoobarGenerator:\n    ...\n\n```\n\nWhen the experiment overrides an existing feature, the new symbol should be created at the same path in the experimental\npackage. This new symbol will override the original in `haystack-ai`: for classes, with a subclass and for bare\nfunctions, with a wrapper. For example:\n\n```python\n# in haystack_experiment/src/haystack_experiment/core/pipeline/pipeline.py\n\nfrom haystack.core.pipeline import Pipeline as HaystackPipeline\n\n\nclass Pipeline(HaystackPipeline):\n    # Any new experimental method that doesn't exist in the original class\n    def run_async(self, inputs) -\u003e Dict[str, Dict[str, Any]]:\n        ...\n\n    # Existing methods with breaking changes to their signature, like adding a new mandatory param\n    def to_dict(self, new_param: str) -\u003e Dict[str, Any]:\n        # do something with the new parameter\n        print(new_param)\n        # call the original method\n        return super().to_dict()\n\n```\n\n## Contributing\n\nDirect contributions to `haystack-experimental` are not expected, but Haystack maintainers might ask contributors to move pull requests that target the [core repository](https://github.com/deepset-ai/haystack) to this repository.\n\n## Telemetry\n\nAs with the Haystack core package, we rely on anonymous usage statistics to determine the impact and usefulness of the experimental features. For more information on what we collect and how we use the data, as well as instructions to opt-out, please refer to our [documentation](https://docs.haystack.deepset.ai/docs/telemetry).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdeepset-ai%2Fhaystack-experimental","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdeepset-ai%2Fhaystack-experimental","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdeepset-ai%2Fhaystack-experimental/lists"}