https://github.com/dbfixtures/pytest-elasticsearch

This is a pytest plugin that enables you to test your code that relies on a running Elasticsearch search engine. It allows you to specify fixtures for Elasticsearch process and client.
https://github.com/dbfixtures/pytest-elasticsearch

elasticsearch pytest pytest-plugin python

Last synced: about 1 month ago
JSON representation

This is a pytest plugin that enables you to test your code that relies on a running Elasticsearch search engine. It allows you to specify fixtures for Elasticsearch process and client.

• Host: GitHub
• URL: https://github.com/dbfixtures/pytest-elasticsearch
• Owner: dbfixtures
• License: lgpl-3.0
• Created: 2016-06-30T14:46:48.000Z (almost 9 years ago)
• Default Branch: main
• Last Pushed: 2025-03-13T05:57:51.000Z (about 2 months ago)
• Last Synced: 2025-03-14T09:38:16.057Z (about 2 months ago)
• Topics: elasticsearch, pytest, pytest-plugin, python
• Language: Python
• Homepage: https://pypi.python.org/pypi/pytest-elasticsearch/
• Size: 1.16 MB
• Stars: 68
• Watchers: 7
• Forks: 22
• Open Issues: 2
• Metadata Files:
  • Readme: README.rst
  • Changelog: CHANGES.rst
  • Contributing: CONTRIBUTING.rst
  • License: COPYING
  • Authors: AUTHORS.rst

Awesome Lists containing this project

README

        

.. image:: https://raw.githubusercontent.com/dbfixtures/pytest-elasticsearch/master/logo.png

    :width: 100px

    :height: 100px

pytest-elasticsearch

====================

.. image:: https://img.shields.io/pypi/v/pytest-elasticsearch.svg

    :target: https://pypi.python.org/pypi/pytest-elasticsearch/

    :alt: Latest PyPI version

.. image:: https://img.shields.io/pypi/wheel/pytest-elasticsearch.svg

    :target: https://pypi.python.org/pypi/pytest-elasticsearch/

    :alt: Wheel Status

.. image:: https://img.shields.io/pypi/pyversions/pytest-elasticsearch.svg

    :target: https://pypi.python.org/pypi/pytest-elasticsearch/

    :alt: Supported Python Versions

.. image:: https://img.shields.io/pypi/l/pytest-elasticsearch.svg

    :target: https://pypi.python.org/pypi/pytest-elasticsearch/

    :alt: License

What is this?

=============

This is a pytest plugin that enables you to test your code that relies on a running Elasticsearch search engine.

It allows you to specify fixtures for Elasticsearch process and client.

How to use

==========

.. warning::

    This plugin requires at least version 6.0 of elasticsearch to work.

The plugin contains two fixtures:

* **elasticsearch** - a client fixture that has functional scope, and which

  cleans Elasticsearch at the end of each test.

* **elasticsearch_proc** - a session scoped fixture, that starts Elasticsearch

  instance at its first use and stops at the end of the tests.

* **elasticsearch_nooproc** - a nooprocess fixture, that's holds connection data

  to already running elasticsearch

Simply include one of these fixtures into your tests fixture list.

You can also create additional elasticsearch client and process fixtures if you'd need to:

.. code-block:: python

    from pytest_elasticsearch import factories

    elasticsearch_my_proc = factories.elasticsearch_proc(port=None)

    elasticsearch_my = factories.elasticsearch('elasticsearch_my_proc')

.. note::

    Each elasticsearch process fixture can be configured in a different way than the others through the fixture factory arguments.

Connecting to already existing Elasticsearch service

----------------------------------------------------

Some projects are using already running Elasticsearch servers

(ie on docker instances). In order to connect to them, one would be using the

``elasticsearch_nooproc`` fixture.

.. code-block:: python

    es_external = factories.elasticsearch('elasticsearch_nooproc')

By default the  ``elasticsearch_nooproc`` fixture would connect to elasticsearch

instance using **9300** port.

Configuration

=============

You can define your settings in three ways, it's fixture factory argument, command line option and pytest.ini configuration option.

You can pick which you prefer, but remember that these settings are handled in the following order:

1. Fixture factory argument

2. Command line option

3. Configuration option in your pytest.ini file

.. list-table:: Configuration options

   :header-rows: 1

   * - ElasticSearch option

     - Fixture factory argument

     - Command line option

     - pytest.ini option

     - Noop process fixture

     - Default

   * - Elasticsearch executable

     - executable

     - --elasticsearch-executable

     - elasticsearch_executable

     -

     - /usr/share/elasticsearch/bin/elasticsearch

   * - host

     - host

     - --elasticsearch-host

     - elasticsearch_host

     - host

     - 127.0.0.1

   * - port

     - port

     - --elasticsearch-port

     - elasticsearch_port

     - 6300

     - random

   * - Elasticsearch cluster name

     - cluster_name

     - --elasticsearch-cluster-name

     - elasticsearch_cluster_name

     - -

     - elasticsearch_cluster_

   * - index storage type

     - index_store_type

     - --elasticsearch-index-store-type

     - elasticsearch_index_store_type

     - -

     - mmapfs

   * - network publish host

     - network_publish_host

     - --elasticsearch-network-publish-host

     - elasticsearch_network_publish_host

     - -

     - 127.0.0.1

   * - transport tcp port

     - transport_tcp_port

     - --elasticsearch-transport-tcp-port

     - elasticsearch_transport_tcp_port

     - -

     - random

Example usage:

* pass it as an argument in your own fixture

    .. code-block:: python

        elasticsearch_proc = factories.elasticsearch_proc(

            cluster_name='awsome_cluster')

* specify your directory as ``elasticsearch_cluster_name`` in your ``pytest.ini`` file.

    To do so, put a line like the following under the ``[pytest]`` section of your ``pytest.ini``:

    .. code-block:: ini

        [pytest]

        elasticsearch_cluster_name = awsome_cluster

Known issues

------------

It might happen, that the process can't be started due to lack of permissions.

The files that user running tests has to have access to are:

* /etc/default/elasticsearch

Make sure that you either run tests as a user that has access to these files,

or you give user proper permissions or add it to proper user groups.

In CI at the moment, we install elasticsearch from tar/zip archives,

which do not set up additional permission restrictions, so it's not a problem on the CI/CD.

Package resources

-----------------

* Bug tracker: https://github.com/dbfixtures/pytest-elasticsearch/issues