{"id":31904111,"url":"https://github.com/cloudfoundry-community/logsearch-boshrelease","last_synced_at":"2025-10-13T13:47:23.846Z","repository":{"id":12169262,"uuid":"71119726","full_name":"cloudfoundry-community/logsearch-boshrelease","owner":"cloudfoundry-community","description":"A BOSH-scalable ELK release","archived":false,"fork":false,"pushed_at":"2025-08-21T00:38:20.000Z","size":15957,"stargazers_count":45,"open_issues_count":14,"forks_count":50,"subscribers_count":36,"default_branch":"develop","last_synced_at":"2025-08-21T02:31:40.617Z","etag":null,"topics":["bosh","bosh-release","cloud-foundry","elk","logsearch"],"latest_commit_sha":null,"homepage":"","language":"Shell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":"hannayurkevich/logsearch-boshrelease","license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/cloudfoundry-community.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2016-10-17T09:07:02.000Z","updated_at":"2025-08-21T00:37:52.000Z","dependencies_parsed_at":"2022-08-30T12:11:55.024Z","dependency_job_id":null,"html_url":"https://github.com/cloudfoundry-community/logsearch-boshrelease","commit_stats":null,"previous_names":[],"tags_count":53,"template":false,"template_full_name":null,"purl":"pkg:github/cloudfoundry-community/logsearch-boshrelease","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cloudfoundry-community%2Flogsearch-boshrelease","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cloudfoundry-community%2Flogsearch-boshrelease/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cloudfoundry-community%2Flogsearch-boshrelease/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cloudfoundry-community%2Flogsearch-boshrelease/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/cloudfoundry-community","download_url":"https://codeload.github.com/cloudfoundry-community/logsearch-boshrelease/tar.gz/refs/heads/develop","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cloudfoundry-community%2Flogsearch-boshrelease/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":279015339,"owners_count":26085685,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-13T02:00:06.723Z","response_time":61,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bosh","bosh-release","cloud-foundry","elk","logsearch"],"created_at":"2025-10-13T13:47:22.350Z","updated_at":"2025-10-13T13:47:23.841Z","avatar_url":"https://github.com/cloudfoundry-community.png","language":"Shell","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Logsearch\n\nA scalable stack of [Elasticsearch](https://www.elastic.co/elasticsearch), [Logstash](https://www.elastic.co/logstash), and [Kibana](https://www.elastic.co/kibana) for your own [BOSH](https://bosh.io/docs)-managed infrastructure.\n\n![logsearch-scheme](docs/img/logsearch.png)\n\n## BREAKING CHANGES\n\n### Logsearch v211 is based on Elastic stack version 7\n\nIn v211.1.0 basic cluster security features were implemented using [Security](https://opendistro.github.io/for-elasticsearch-docs/docs/install/plugins/) plugin from OpenDistro Elasticsearch implementation. For better handling of these features, a following changes was made:\n\n- Additional Elasticsearch job has been colocated on **Maintenance** instance. This allows secure communication over localhost for all singletons also colocated there (all singletons have been unlinked from any remote Elasticsearch cluster, and bound to local one).\n- Since using of Ls-rounter instance is not mandatory - it was moved to separate [ops-file](deployment/operations/enable-router.yml).\n- Secure Elasticsearch node-to-node communication has been implemented using [enable-tls](deployment/operations/enable-tls.yml) ops-file.\n- Secure ingesting logs is implemented using [enable-ssl](deployment/operations/enable-ssl.yml) ops-file.\n\n### Logsearch v210 is based on Elastic stack version 6\n\n- Elasticsearch 6.x can use indices created in Elasticsearch 5.x, but not those created in Elasticsearch 2.x or before.\n- **Important**: After upgrading running 5.x cluster to 6.x all existing indicies will be available for reading data. However, writing to these indicies is not possible. In order to write data immediately after upgrade you have to [change index naming convention](https://github.com/cloudfoundry-community/logsearch-boshrelease/commit/2f83b41ee14dbe3141e21cc0c40df340d50e0169). As long as index names are usually based on current date, this change can be safely reverted in a day or so.\n\n### Logsearch v204 is based on Elastic stack version 5.\n\n- For upgrade procedure from Elasticsearch 2.x please refer to [v205.0.0 release notes](https://github.com/cloudfoundry-community/logsearch-boshrelease/releases/tag/v205.0.0#component-updates).\n\n### Logsearch v200 is based on Elasticsearch 2.x and Kibana 4.\n\n- There is NO upgrade path from Elasticsearch 1.x to 2.x. Sorry :(\n\n### Logsearch \u003c v23 was based on Elasticsearch 1.x and Kibana 3.\n\n## Getting Started\n\nThis repo contains Logsearch Core; which deploys an ELK cluster that can receive and parse logs via syslog that contain JSON.\n\nMost users will want to combine Logsearch Core with a Logsearch Addon to customise their cluster for a\nparticular type of logs. Its likely you want to be following an Addon installation guides - see below\nfor a list of the common Addons:\n\n- [Logsearch for CloudFoundry](https://github.com/cloud-gov/logsearch-for-cloudfoundry)\n\n## Installing Logsearch Core\n\nBefore starting deployment, make sure your BOSH environment is ready, and all `BOSH_` evironment variables are set. We suggest you to use [BBL](https://github.com/cloudfoundry/bosh-bootloader) tool to spin up the BOSH environment.\n\n```\n$ cd deployment\n$ bosh -d logsearch deploy logsearch-deployment.yml\n```\n\n## Common customisations:\n\nAdding new parsing rules:\n\n        logstash_parser:\n          filters: |\n             # Put your additional Logstash filter config here, eg:\n             json {\n                source =\u003e \"@message\"\n                remove_field =\u003e [\"@message\"]\n             }\n\n### Release Channels\n\n- The latest stable, final release will be soon available on [bosh.io](http://bosh.io/releases)\n- **develop** - The develop branch in this repo is deployed to our test environments. It is occasionally broken - use with care!\n\n## Known issues\n\n## License\n\n[Apache License 2.0](./LICENSE)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcloudfoundry-community%2Flogsearch-boshrelease","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcloudfoundry-community%2Flogsearch-boshrelease","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcloudfoundry-community%2Flogsearch-boshrelease/lists"}