{"id":21357816,"url":"https://github.com/rcbops/elk-formula","last_synced_at":"2025-07-13T00:33:27.082Z","repository":{"id":22690038,"uuid":"26033842","full_name":"rcbops/elk-formula","owner":"rcbops","description":null,"archived":false,"fork":false,"pushed_at":"2015-08-25T21:27:04.000Z","size":177,"stargazers_count":2,"open_issues_count":1,"forks_count":7,"subscribers_count":5,"default_branch":"master","last_synced_at":"2024-04-14T15:54:41.964Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"SaltStack","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/rcbops.png","metadata":{"files":{"readme":"README.rst","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2014-10-31T21:34:19.000Z","updated_at":"2020-06-14T00:02:56.000Z","dependencies_parsed_at":"2022-07-27T03:17:11.716Z","dependency_job_id":null,"html_url":"https://github.com/rcbops/elk-formula","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rcbops%2Felk-formula","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rcbops%2Felk-formula/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rcbops%2Felk-formula/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rcbops%2Felk-formula/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/rcbops","download_url":"https://codeload.github.com/rcbops/elk-formula/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":225844818,"owners_count":17533161,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-22T05:12:31.152Z","updated_at":"2024-11-22T05:12:31.819Z","avatar_url":"https://github.com/rcbops.png","language":"SaltStack","funding_links":[],"categories":[],"sub_categories":[],"readme":"elasticsearch-logstash-kibana\n=============================\n\nSaltstack formulae for installing logstash server with kibana and logstash shippers on your other machines.\nRequires at least 1 standalone haproxy, alongside 1 node with elasticsearch, kibana and logstash.\nELK roles can be applied to as many servers as desired and be split up or combined.\n\n** Nothing will show up in Kibana until you configure a server to send syslog events to haproxy node on port 5544 or create your own logstash config. (See logstash info below) **\n\n\n\n\nKibana\n------\nruns on port 8080 (this can be changed via pillar). In the UI the \"Sample Dashboard\" is a good place to start.\n\nLogstash \n--------\nhas an example config that listens for syslog events on 5544 and saves them to elasticsearch. To make this work rsyslog should be configured on some node to ship logs to haproxy node on 5544 (this will load balance between available logstash nodes). There is also another simple example for logstash that listens to /var/log/nginx/access.log but it needs nginx to be installed. To configure rsyslog to forward logs some examples can be found at the following links:\nhttps://community.ulyaoth.net/threads/how-to-install-logstash-kibana-on-fedora-using-rsyslog-as-shipper.11/\nhttp://capnjosh.com/blog/forwarding-logs-to-logstash-1-4-with-rsyslog-working-nginx-logs-too/\n\n\n\n/etc/rsyslog.d/logstash.conf\n$ModLoad imfile\n\n$InputFileName /var/log/nginx/error.log\n$InputFileTag nginx-errorlog:\n$InputFileStateFile state-nginx-errorlog\n$InputRunFileMonitor\n\n$InputFileName /var/log/nginx/access.log\n$InputFileTag nginx-accesslog:\n$InputFileStateFile state-nginx-accesslog\n$InputRunFileMonitor\n\n$InputFilePollInterval 10\n\nif $programname == ‘nginx-errorlog’ then @{{ haproxy_ip }}:5544\nif $programname == ‘nginx-errorlog’ then ~\nif $programname == ‘nginx-accesslog’ then @{{ haproxy_ip }}:5544\nif $programname == ‘nginx-accesslog’ then ~\n\n\n\n\n\n\n\n\n\n\nElasticsearch\n-------------\nnodes automatically become part of a cluster and listen on 9200 and 9300\n\n\n\n.. note::\n\n    See the full `Salt Formulas installation and usage instructions\n    \u003chttp://docs.saltstack.com/en/latest/topics/development/conventions/formulas.html\u003e`_.\n\n#### How to use\nIf applying from a top file:\n```shell\nsalt \u003csync-targets\u003e state.highstate\n```\nOr if applying explicitly:\n```shell\nsalt \u003csync-targets\u003e state.sls elk-formula.elk\n```\n\n#### Helpful links\n* [ELK](http://www.elasticsearch.org/overview/)\n* [RSYSLOG_FORWARDING] (https://community.ulyaoth.net/threads/how-to-install-logstash-kibana-on-fedora-using-rsyslog-as-shipper.11/)\n* [RSYSLOG_FORWARDING2] (http://capnjosh.com/blog/forwarding-logs-to-logstash-1-4-with-rsyslog-working-nginx-logs-too/)","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frcbops%2Felk-formula","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Frcbops%2Felk-formula","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frcbops%2Felk-formula/lists"}