elasticsearch-collection

An ongoing & curated collection of awesome software, libraries, learning tutorials, and most important tools, esources and cool stuff about Elasticsearch
https://github.com/exajobs/elasticsearch-collection

Last synced: about 18 hours ago
JSON representation

Scalable Infrastructure and performance
- Use cases for Elasticsearch
- Docker and Elasticsearch
  - The Authoritative Guide to Elasticsearch Performance Tuning (Part 1) - performance-tuning-part-2-zen) [Part 3](https://qbox.io/index.php?p=blog/authoritative-guide-elasticsearch-performance-tuning-part-3)
  - Tuning data ingestion performance for Elasticsearch on Azure - and not only for Azure. That's a great article about Elasticsearch Performance testing by example
  - Elasticsearch Indexing Performance Cheatsheet - when you plan to index large amounts of data in Elasticsearch (by Patrick Peschlow)
  - Elasticsearch for Logging
  - Scaling Elasticsearch to Hundreds of Developers
  - Understanding Elasticsearch Performance
  - Our Experience of Creating Large Scale Log Search System Using Elasticsearch - topology, separate master, data and search balancers nodes
  - Elasticsearch on Azure Guidance
  - How to avoid the split-brain problem in Elasticsearch
  - How to monitor Elasticsearch performance
  - How to collect Elasticsearch metrics
  - How to monitor Elasticsearch with Datadog
  - How to solve 5 Elasticsearch performance and scaling problems
  - Performance Monitoring Essentials - Elasticsearch Edition
- Integrations
  - Apache Hive integration
  - Connecting Tableau to Elasticsearch (READ: How to query Elasticsearch with Hive SQL and Hadoop)
- Logging
  - 5 Logstash Alternatives
- Alerts
- Time series
  - Elasticsearch as a Time Series Data Store
  - Running derivatives on Voyager velocity data - Smithe
  - Part 1 - [Part 2](https://www.elastic.co/blog/staying-in-control-with-moving-averages-part-2) by Zachary Tong
  - Part 1 - [Part 2](https://www.elastic.co/blog/implementing-a-statistical-anomaly-detector-part-2) - [Part 3](https://www.elastic.co/blog/implementing-a-statistical-anomaly-detector-part-3) by Zachary Tong
- Machine Learning
  - Classifying images into Elasticsearch with DeepDetect - images-with-deep-learning-into-elasticsearch/33217)) by Emmanuel Benazera
  - Elasticsearch with Machine Learning - elasticsearch/elasticsearch-amazon-machine-learning-7d7b979c328d&usg=ALkJrhioEPGsVRglGPFTa6w2ZfM-ydSoeg)) by Kunihiko Kido
  - Recommender System with Mahout and Elasticsearch
`What is ElasticSearch?`
- - Elasticsearch - source search and analytics engine built on Apache Lucene and developed in Java. . It was developed in Java and is designed to operate in real time. It can search and index document files in diverse formats. It was designed to be used in distributed environments by providing flexibility and scalability. Now, Elasticsearch is a widely popular enterprise search engine. Elasticsearch allows you to store, search, and analyze huge volumes of data quickly and in near real-time and give back answers in milliseconds.
- `How does it work?`
  - Elasticsearch
`Elastic Architecture`
- `Indices`
  - Best Practices for Managing Elasticsearch Indices - Understanding indices
`Elastic Stack`
- `Indices`
  - Elasticsearch
  - Logstash
  - Kibana
  - beats
  - beats
  - Logstash
  - Kibana
`Books`
- `Indices`
  - Deep Learning for Search - teaches you how to leverage neural networks, NLP, and deep learning techniques to improve search performance. (2019)
  - Relevant Search: with applications for Solr and Elasticsearch - demystifies relevance work. Using Elasticsearch, it teaches you how to return engaging search results to your users, helping you understand and leverage the internals of Lucene-based search engines. (2016)
  - Elasticsearch in Action - teaches you how to build scalable search applications using Elasticsearch (2015)
  - Elasticsearch in Action, Second edition - hands-on guide to developing fully functional search engines with Elasticsearch and Kibana. (2021)
`Certifications`
- Elastic Certified Engineer
  - Elastic Certified Engineer notes - notes and exercises to prepare the certification exam
Open-source and free products, based on Elasticsearch
- Elastic Certified Engineer
  - Fess - crawler
  - appbaseio/reactivemaps
  - appbaseio/reactivesearch
  - logagent
  - Sentinl - Sentinl is a Kibana alerting and reporting app.
  - Praeco - Elasticsearch alerting made simple
  - Yelp/elastalert
  - etsy/411 - an Alert Management Web Application https://demo.fouroneone.io (credentials: user/user)
  - appbaseio/mirage
  - exceptionless/Exceptionless
  - searchkit/searchkit
  - Simple File Server
  - ItemsAPI
  - Kuzzle - An open-source backend with advanced real-time features for Web, Mobile and IoT that uses ElasticSearch as a database. ([Website](https://kuzzle.io/))
  - SIAC - SIAC is an enterprise SIEM built on the ELK stack and other open-source components.
  - DataStation - Easily query, script, and visualize data from every database, file, and API.
  - Sentinl - Sentinl is a Kibana alerting and reporting app.
  - Praeco - Elasticsearch alerting made simple
  - appbaseio/dejavu
Who is using elasticsearch?
- Code, configuration file samples and other gists
  - NASA
  - StackExchange
  - Yelp
  - Raygun
  - Mozilla
  - Spotify
  - CERN
  - Zalando
  - IFTTT
Elasticsearch developer tools and utilities
- Development and debugging
- Import and Export
  - elasticdump - tools for moving and saving indices
  - Knapsack plugin
  - Elasticsearch-Exporter
  - esbulk
  - elasticsearch-loader - Tool for loading common file types to elasticsearch including csv, json, and parquet
- Management
  - Esctl - High-level command line interface to manage Elasticsearch clusters.
  - Vulcanizer - Github's open sourced cluster management library based on Elasticsearch's REST API. Comes with a high level CLI tool
Elasticsearch plugins
- Cluster
  - Bigdesk - Live charts and statistics for elasticsearch cluster
  - Elastic HQ - Elasticsearch cluster management console with live monitoring and beautiful UI
  - ee-outliers - ee-outliers is a framework to detect outliers in events stored in an Elasticsearch cluster.
  - sscarduzio/elasticsearch-readonlyrest-plugin
  - mobz/elasticsearch-head
  - Cerebro
  - Kopf - Another management plugin that have REST console and *manual* shard allocation
  - Search Guard - Elasticsearch and elastic stack security and alerting for free
  - Elasticsearch Comrade - Elasticsearch admin panel built for ops and monitoring
  - elasticsearch-admin - Web administration for Elasticsearch
- Other
  - SIREn Join Plugin for Elasticsearch
- Integrations and SQL support
  - elastic/elasticsearch-hadoop - Elasticsearch real-time search and analytics natively integrated with Hadoop (and Hive)
  - jprante/elasticsearch-jdbc - JDBC importer for Elasticsearch
  - pandasticsearch - An Elasticsearch client exposing DataFrame API
  - monstache - Go daemon that syncs MongoDB to Elasticsearch in near realtime
- You know, for search
  - jprante/elasticsearch-plugin-bundle
Kibana plugins and applications
- You know, for search
  - Kibana Alert App for Elasticsearch - Kibana plugin with monitoring, alerting and reporting capabilities
  - VulnWhisperer - VulnWhisperer is a vulnerability data and report aggregator.
  - Wazuh Kibana App - A Kibana app for working with data generated by [Wazuh](https://wazuh.com/).
  - Datasweet Formula - A real time calculated metric plugin [Datasweet Formula](http://www.datasweet.fr/datasweet-formula/).
  - elastic/timelion - series analyses application. Overview and installation guide: Timelion: [The time series composer for Kibana](https://www.elastic.co/blog/timelion-timeline)
- Kibana Visualization plugins
  - nbs-system/mapster - a visualization which allows to create live event 3d maps in Kibana
  - Kibana Tag Cloud Plugin - tag cloud visualization plugin based on d3-cloud plugin
  - LogTrail - a plugin for Kibana to view, analyze, search and tail log events from multiple hosts in realtime with devops friendly interface inspired by Papertrail
  - Analyze API - Kibana 6 application to manipulate the `_analyze` API graphically
  - kbn_network - This is a plugin developed for Kibana that displays a network node that link two fields that have been previously selected.
Discussions and social media
- Kibana Visualization plugins
Tutorials
- Kibana Visualization plugins
  - Centralized Logging with Logstash and Kibana On Ubuntu 14.04
  - Make Sense of your Logs: From Zero to Hero in less than an Hour! by Britta Weber
  - $$ Elasticsearch 7 and Elastic Stack - liveVideo course that teaches you to search, analyze, and visualize big data on a cluster with Elasticsearch, Logstash, Beats, Kibana, and more.
Articles
- Kibana Visualization plugins
  - Elasticsearch Intro - Elasticsearch: What it is, How it works, and what it’s used for.
System configuration
- Kibana Visualization plugins
- Docker and Elasticsearch
  - Running an Elasticsearch cluster with Docker
Java tuning
- Docker and Elasticsearch
Other
- Use cases for Elasticsearch
  - LogZoom, a fast and lightweight substitute for Logstash
  - Building a Directory Map With ELK
  - Structured logging with ELK - part 1
  - Search for :yum: Emoji with Elasticsearch :mag_right:
  - Complete Guide to the ELK Stack
  - Elasticsearch Engineer Interview Questions
  - ElasticSearch Report Engine - An ElasticSearch plugin to return query results as either PDF,HTML or CSV.
  - Elasticsearch Glossary - explanations of Elasticsearch terminology, including examples, common best practices and troubleshooting guides for various issues.
  - Elasticsearch Engineer Interview Questions
Videos
- Overviews
- Advanced
  - #bbuzz 2015: Adrien Grand – Algorithms and data-structures that power Lucene and Elasticsearch
  - Rafał Kuć - Running High Performance Fault-tolerant Elasticsearch Clusters on Docker - in-docker/)
  - Working with Elasticsearch - Search, Aggregate, Analyze, and Scale Large Volume Datastores - O'Reilly Media
  - End-to-end Recommender System with Spark and Elasticsearch - François Puget. [Slide deck](http://www.slideshare.net/sparktc/spark-ml-meedup-pentreath-puget)
- Code, configuration file samples and other gists
  - Elasticsearch config for a write-heavy cluster - reyjrar/elasticsearch.yml
Related (awesome) lists
- Elastic Certified Engineer
  - frutik/awesome-search - commerce search now. Below are listed some of my build blocks

Programming Languages

JavaScript 14 Java 7 Python 6 TypeScript 5 Go 3 PHP 2 Vue 1 Scala 1 CoffeeScript 1 Emacs Lisp 1

elasticsearch-collection

Scalable Infrastructure and performance

Use cases for Elasticsearch

Docker and Elasticsearch

Integrations

Logging

Alerts

Time series

Machine Learning

`What is ElasticSearch?`

`How does it work?`

`Elastic Architecture`

`Indices`

`Elastic Stack`

`Indices`

`Books`

`Indices`

`Certifications`

Elastic Certified Engineer

Open-source and free products, based on Elasticsearch

Elastic Certified Engineer

Who is using elasticsearch?

Code, configuration file samples and other gists

Elasticsearch developer tools and utilities

Development and debugging

Import and Export

Management

Elasticsearch plugins

Cluster

Other

Integrations and SQL support

You know, for search

Kibana plugins and applications

You know, for search

Kibana Visualization plugins

Discussions and social media

Kibana Visualization plugins

Tutorials

Kibana Visualization plugins

Articles

Kibana Visualization plugins

System configuration

Kibana Visualization plugins

Docker and Elasticsearch

Java tuning

Docker and Elasticsearch

Other

Use cases for Elasticsearch

Videos

Overviews

Advanced

Code, configuration file samples and other gists

Related (awesome) lists

Elastic Certified Engineer