https://github.com/leakix/estk

ES ToolKit is a standalone solution to navigate and backup data for a wide range of Elasticsearch and Kibana versions.
https://github.com/leakix/estk

backup elasticsearch

Last synced: 11 days ago
JSON representation

ES ToolKit is a standalone solution to navigate and backup data for a wide range of Elasticsearch and Kibana versions.

• Host: GitHub
• URL: https://github.com/leakix/estk
• Owner: LeakIX
• License: mit
• Created: 2020-12-16T18:14:35.000Z (over 4 years ago)
• Default Branch: master
• Last Pushed: 2023-09-14T11:59:20.000Z (over 1 year ago)
• Last Synced: 2025-04-24T00:12:10.652Z (17 days ago)
• Topics: backup, elasticsearch
• Language: Go
• Homepage:
• Size: 25.4 KB
• Stars: 82
• Watchers: 2
• Forks: 21
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# ES Toolkit

[![GitHub Release](https://img.shields.io/github/v/release/LeakIX/estk)](https://github.com/LeakIX/estk/releases)

[![Follow on Twitter](https://img.shields.io/twitter/follow/leak_ix.svg?logo=twitter)](https://twitter.com/leak_ix)

ES ToolKit is a standalone solution to navigate and backup data for a 

wide range of Elasticsearch and Kibana versions.

![estk Output](https://i.imgur.com/behg3qJ.gif)

## Features

- Automatic software and version detection

- Query support

- Low memory/CPU footprint

- Dump directly to file or stdout

- Live progress

- Proxy support

## Usage

### List index

```

estk list -h

```

Displays help for the list command.

|Flag           |Description  |

|-----------------------|-------------------------------------------------------|

|--url     | Elasticsearch/Kibana root URL |

### Dump index

```

estk dump -h

```

Displays help for the dump command.

|Flag           |Description  |

|-----------------------|-------------------------------------------------------|

|--url     | Elasticsearch/Kibana root URL |

|--index     | Name of the index to dump ( wildcard supported ) |

|--query-string | Dump specific documents |

|--size| Bulk size, max amount of document per request|

## Installation Instructions

### From Binary

The installation is easy. You can download the pre-built binaries for your platform from the [Releases](https://github.com/LeakIX/estk/releases/) page.

```sh

▶ chmod +x estk-linux-64

▶ mv estk-linux-64 /usr/local/bin/estk

```

### From Source

```sh

▶ go install github.com/LeakIX/estk@master

```

## Running estk

```sh

▶ estk --url http://127.0.0.1:5602 dump -i "hostserviceleak" -o hostserviceleak.json -d -q "type:mysql"

2020/12/16 20:12:15 Detecting version...

2020/12/16 20:12:15 Trying elasticsearch

2020/12/16 20:12:15 Trying Kibana

2020/12/16 20:12:15 Found kibana, major version 7

2020/12/16 20:12:15 Dump starting...

2020/12/16 20:12:15 Endpoint : http://127.0.0.1:5602

2020/12/16 20:12:15 Index : hostserviceleak

2020/12/16 20:12:15 Output file : hostserviceleak.json

2020/12/16 20:12:16 Got scrollId : FGluY2x1ZGVfY29udGV4dF91dWlkDnF1ZXJ5VGhlbkZldGNoAhRLRVQzYkhZQnowRHZjdlFkblNHWgAAAAABlhWbFnpNNWpoU3RhUk5Td3hCVXAxd1k2TUEUS1VUM2JIWUJ6MER2Y3ZRZG5TR1oAAAAAAZYVnBZ6TTVqaFN0YVJOU3d4QlVwMXdZNk1B

2020/12/16 20:12:16 Dumping 2292659 documents :

   1% |                                                    | (34201/2292659, 242 it/s) [2m23s:2h35m22s]

```