https://github.com/bigdataboutique/elasticsearch-cloud-deploy
Deploy Elasticsearch on the cloud easily
https://github.com/bigdataboutique/elasticsearch-cloud-deploy
aws elasticsearch packer terraform
Last synced: 17 days ago
JSON representation
Deploy Elasticsearch on the cloud easily
- Host: GitHub
- URL: https://github.com/bigdataboutique/elasticsearch-cloud-deploy
- Owner: BigDataBoutique
- License: apache-2.0
- Created: 2016-12-15T11:00:09.000Z (over 8 years ago)
- Default Branch: master
- Last Pushed: 2025-02-06T10:36:47.000Z (3 months ago)
- Last Synced: 2025-04-01T00:33:57.312Z (24 days ago)
- Topics: aws, elasticsearch, packer, terraform
- Language: HCL
- Homepage: https://bigdataboutique.com/services/elasticsearch-consulting
- Size: 314 KB
- Stars: 331
- Watchers: 20
- Forks: 146
- Open Issues: 26
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Deploy Elasticsearch on the cloud easily
This repository contains a set of tools and scripts to deploy an Elasticsearch cluster on the cloud, using best-practices and state of the art tooling.
Need to monitor and optimize your cluster after setting it up? Consider using [Pulse](https://pulse.support/).
***Note:*** This branch supports Elasticsearch 7.x only. For other Elasticsearch versions see [feat-8x](https://github.com/BigDataBoutique/elasticsearch-cloud-deploy/tree/feat-8x), [elasticsearch-5.x](https://github.com/BigDataBoutique/elasticsearch-cloud-deploy/tree/elasticsearch-5.x) and [elasticsearch-6.x](https://github.com/BigDataBoutique/elasticsearch-cloud-deploy/tree/elasticsearch-6.x) branches.
You need to use the latest version of Terraform and Packer for all features to work correctly.
Features:
* Deployment of data and master nodes as separate nodes, as well as data-voters
* Client node with Kibana and authenticated Elasticsearch access
* Single node cluster support
* DNS and load-balancing access to client nodes
* Sealed from external access, only accessible via password-protected external facing client nodes
* AWS deployment support (under `terraform-aws`)
* Google Cloud Platform deployment (under `terraform-gcp`)
* Packer scripts for both GCP and AWS (under `packer`)
* Azure deployment - not maintained at the moment (under `terraform-azure`)
## Usage
Clone this repo to work locally. You might want to fork it in case you need to apply some additional configurations or commit changes to the variables file.
Create images with Packer (see `packer` folder in this repo), and then go into the terraform folder and run `terraform plan`. See README files in each respective folder.
## tfstate
Once you run `terraform apply` on any of the terraform folders in this repo, a file `terraform.tfstate` will be created. This file contains the mapping between your cloud elements to the terraform configuration. Make sure to keep this file safe.
See [this guide](https://blog.gruntwork.io/how-to-manage-terraform-state-28f5697e68fa#.fbb2nalw6) for a discussion on tfstate management and locking between team members.