Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/sematext/logagent-js
Extensible log shipper with input/output plugins, buffering, parsing, data masking, and small memory/CPU footprint
https://github.com/sematext/logagent-js
elk elk-stack javascript log-collector log-management logagent logging logs logshipper nodejs
Last synced: about 1 month ago
JSON representation
Extensible log shipper with input/output plugins, buffering, parsing, data masking, and small memory/CPU footprint
- Host: GitHub
- URL: https://github.com/sematext/logagent-js
- Owner: sematext
- License: apache-2.0
- Created: 2015-07-25T09:09:07.000Z (about 9 years ago)
- Default Branch: master
- Last Pushed: 2023-10-19T23:20:24.000Z (11 months ago)
- Last Synced: 2024-07-14T14:02:20.153Z (about 2 months ago)
- Topics: elk, elk-stack, javascript, log-collector, log-management, logagent, logging, logs, logshipper, nodejs
- Language: JavaScript
- Homepage: https://sematext.com/logagent
- Size: 5.25 MB
- Stars: 390
- Watchers: 23
- Forks: 79
- Open Issues: 39
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- License: LICENSE
Awesome Lists containing this project
- awesome - logagent-js - Extensible log shipper with input/output plugins, buffering, parsing, data masking, and small memory/CPU footprint (JavaScript)
- awesome-influxdb - logagent - is a modern, open-source, light-weight log shipper. Logagent includes [influxdb input plugin](https://sematext.com/docs/logagent/input-plugin-influxdb-http/) and [influxdb output plugin](https://sematext.com/docs/logagent/output-plugin-influxdb/) and many other [integrations](https://sematext.com/docs/logagent/plugins/) (Collecting data into InfluxDB / Projects)
README
[](https://travis-ci.org/sematext/logagent-js)
[](https://heroku.com/deploy?template=https://github.com/sematext/logagent-js) - [read more](http://blog.sematext.com/2016/02/18/how-to-ship-heroku-logs-to-logsene-managed-elk-stack/)
# What is Logagent
[Logagent](https://sematext.com/logagent) is a modern, open-source, light-weight log shipper. It is like Filebeat and Logstash in one, without the JVM memory footprint. It comes with out of the box and extensible log parsing, on-disk buffering, secure transport, and bulk indexing to Elasticsearch, [Sematext Logs](https://sematext.com/logsene), and other destinations. Its low memory footprint and low CPU overhead make it suitable for deploying on edge nodes and devices, while its ability to parse and structure logs makes it a great Logstash alternative.
# Docker
Details about the the Logagent Docker image are described in the [Docker Hub Readme](https://github.com/sematext/logagent-js/blob/master/dockerhub/README.md)
# Installation
**1) Install Node.js**
Official Node.js [downloads and instructions](https://nodejs.org/en/download/). E.g. for Debian/Ubuntu:
```
curl -sL https://deb.nodesource.com/setup_10.x | sudo -E bash -
sudo apt-get install -y nodejs
Install Logagent with npm
sudo npm i -g @sematext/logagent
```
**2) Run logagent command line tool**
```
logagent --help
```
**3) Example: Index your log files in Elasticsearch**
```
logagent -e http://localhost:9200 -i logs -g ‘/var/log/**/*.log’
```
**4) Optional: Install service & config**
Install service for Logagent using systemd, upstart, launchd
To quickly create a config file for indexing into Elasticsearch without having to edit it run something like this:
```
sudo logagent-setup -u http://localhost:9200 -i INDEX_NAME -g '/var/log/**/*.log'
# Logsene US: use -u https://logsene-receiver.sematext.com and your Logsene App Token as index name.
# Logsene EU: use -u https://logsene-receiver.eu.sematext.com and your Logsene App Token as index name.
```
**Configuration**
To configure different inputs, different event processing, or different outputs (e.g. your own Elasticsearch) edit /etc/sematext/logagent.conf, e.g.:
```
output:
logsene:
module: elasticsearch
url: http://elasticsearch-server:9200
index: logs
```
Then restart the service with sudo service logagent restart.
Troubleshooting & Logs
Logagent’s own logs:
* Upstart: `/var/log/upstart/logagent.log`
* Systemd: `journalctl -u logagent`
* Launchd: `/Library/Logs/logagent.log`
Location of service scripts:
* Upstart: `/etc/init/logagent.conf`
* Systemd: `/etc/systemd/system/logagent.service`
* Launchd: `/Library/LaunchDaemons/com.sematext.logagent.plist`
Start/stop service:
* Upstart: `service logagent stop/start`
* Systemd: `systemctl stop/start logagent`
* Launchd: `launchctl start/stop com.sematext.logagent`
# Documentation & Support
* [Full documentation](http://sematext.com/docs/logagent/)
* [Logagent main page](https://sematext.com/logagent)
* [Logagent on Github](https://github.com/sematext/logagent-js)
* Forum: [https://groups.google.com/forum/#!forum/logagent](https://groups.google.com/forum/#!forum/logagent)
* Twitter: [@sematext](https://twitter.com/sematext)
* Blog: [sematext.com/blog](https://sematext.com/blog)
# Development
* Update to the last node version
* From root folder node type: node ./bin/logagent -h
* To test from root folder type: node test