https://github.com/natlee/es-in-docker-with-eland

This is an example of Elasticsearch in Docker with Eland.
https://github.com/natlee/es-in-docker-with-eland

docker docker-compose docker-compose-template eland elasticsearch elasticsearch-python python

Last synced: about 1 month ago
JSON representation

This is an example of Elasticsearch in Docker with Eland.

• Host: GitHub
• URL: https://github.com/natlee/es-in-docker-with-eland
• Owner: NatLee
• Created: 2024-08-23T03:43:04.000Z (3 months ago)
• Default Branch: main
• Last Pushed: 2024-08-29T02:51:57.000Z (3 months ago)
• Last Synced: 2024-10-11T22:02:55.950Z (about 1 month ago)
• Topics: docker, docker-compose, docker-compose-template, eland, elasticsearch, elasticsearch-python, python
• Language: Jupyter Notebook
• Homepage:
• Size: 65.4 KB
• Stars: 3
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Example of Elasticsearch in Docker with Eland

[[EN](./README.md)|[TW](./README.zh-TW.md)]

This is an example of Elasticsearch in Docker with Eland.

## Usage

> In some cases, you may need to increase the maximum of virtual memory by running `sysctl -w vm.max_map_count=262144`.

1. Check `.env` file and set the values if needed.

2. Create a folder for Elasticsearch data:

    > If you don't change the mode of the folder, you may encounter permission errors with Elasticsearch.

    ```bash

    mkdir ./es-data && chmod 777 ./es-data

    ```

3. Start Elasticsearch stacks:

    ```bash

    docker-compose up -d

    ```

4. When Elasticsearch is running, you can copy the cert files to host with the following command:

    ```bash

    bash dev-cp-cert.sh

    ```

5. Create an environment and install the required packages:

    ```bash

    conda create -n es-test python=3.11

    conda activate es-test

    pip install -r requirements.txt

    ```

6. Check 2 ipynb files in `notebooks` folder for examples.

    - `eland-test.ipynb`: Basic Elasticsearch operations with Eland.

    - `eland-over-10000-test.ipynb`: Basic Elasticsearch operations with Eland for over 10000 records.

7. (Optional) Visit `Kibana` with the following URL:

    ```

    https://localhost:5601

    ```

    The default username is `elastic` and the password is in the `.env` file.