Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/logzio/logzio-nodejs

NodeJS logger for LogzIO
https://github.com/logzio/logzio-nodejs

elk-stack integration logging-library logzio nodejs-logger

Last synced: 4 days ago
JSON representation

NodeJS logger for LogzIO

Host: GitHub
URL: https://github.com/logzio/logzio-nodejs
Owner: logzio
License: apache-2.0
Created: 2015-04-28T08:36:00.000Z (over 9 years ago)
Default Branch: master
Last Pushed: 2024-09-16T15:33:30.000Z (2 months ago)
Last Synced: 2024-10-28T10:55:23.086Z (23 days ago)
Topics: elk-stack, integration, logging-library, logzio, nodejs-logger
Language: JavaScript
Homepage:
Size: 860 KB
Stars: 36
Watchers: 20
Forks: 38
Open Issues: 15
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE

Awesome Lists containing this project

README

![Build Status](https://travis-ci.org/logzio/logzio-nodejs.svg?branch=master)

# logzio-nodejs
NodeJS logger for Logz.io.
The logger stashes the log messages you send into an array which is sent as a bulk once it reaches its size limit (100 messages) or time limit (10 sec) in an async fashion.
It contains a simple retry mechanism which upon connection reset (server side) or client timeout, wait a bit (default interval of 2 seconds), and try this bulk again. It does not block other messages from being accumulated and sent (async). The interval increases by a factor of 2 between each retry until it reaches the maximum allowed attempts (3).

By default, any error is logged to the console. This can be changed by supplying a callback function.

## Before you begin you will need:
- `Nodejs` with version 14.x or above

## Sample usage
```javascript
var logger = require('logzio-nodejs').createLogger({
token: '__YOUR_ACCOUNT_TOKEN__',
type: 'YourLogType' // OPTIONAL (If none is set, it will be 'nodejs')
});

// sending text
logger.log('This is a log message');

// sending an object
var obj = {
message: 'Some log message',
param1: 'val1',
param2: 'val2'
};
logger.log(obj);
```

**Note:** If logzio-js is used as part of a serverless service (AWS Lambda, Azure Functions, Google Cloud Functions, etc.), add `logger.sendAndClose()` at the end of the run. For example [sync Lambda](https://github.com/logzio/logzio-nodejs/blob/master/Serverless/lambda-sync.md) and [async Lambda](https://github.com/logzio/logzio-nodejs/blob/master/Serverless/lambda-async.md)

## Options

* **token**
Mandatory. Your account token. Look it up in the Device Config tab in Logz.io
* **type** - Log type. Help classify logs into different classifications
* **protocol** - `http`, `https` or `udp`. Default: `http`
* **host** - Destination host name. Default: `listener.logz.io`
* **port** - Destination port. Default port depends on protocol. For `udp` default port is `5050`, for `http` is `8070` and `8071` is for `https`
* **sendIntervalMs** - Time in milliseconds to wait between retry attempts. Default: `2000` (2 sec)
* **bufferSize** - The maximum number of messages the logger will accumulate before sending them all as a bulk. Default: `100`.
* **numberOfRetries** - The maximum number of retry attempts. Default: `3`
* **debug** - Should the logger print debug messages to the console? Default: `false`
* **callback** - A callback function called when an unrecoverable error has occured in the logger. The function API is: function(err) - err being the Error object.
* **timeout** - The read/write/connection timeout in milliseconds.
* **addTimestampWithNanoSecs** - Add a timestamp with nano seconds granularity. This is needed when many logs are sent in the same millisecond, so you can properly order the logs in kibana. The added timestamp field will be `@timestamp_nano` Default: `false`
* **compress** - If true the the logs are compressed in gzip format. Default: `false`
* **internalLogger** - set internal logger that supports the function log. Default: console.
* **extraFields** - Adds your own custom fields to each log. Add in JSON Format, for example: `extraFields : { field_1: "val_1", field_2: "val_2" , ... }`.

## Using UDP
A few notes are worth mentioning regarding the use of the UDP protocol:
* UDP has some limitations, and therefore it is not the recommended protocol:
* There is no guarantee that the logs have been received.
* UDP can't take advantage of the bulk API, so performance is sub-optimal.
* When using UDP, each message is sent separately, and not using the bulk API. This means that the meaning of `bufferSize` is slightly different in this case. The messages will still be sent separately, but the logger will wait for the buffer to reach the size specified before sending out all the messages. If you want each message to be sent out immediately, then set `bufferSize = 1`.

## Build and test locally
1. Clone the repository:
```bash
git clone https://github.com/logzio/logzio-nodejs.git
cd logzio-nodejs
```
2. Build and run tests:
```bash
npm install
npm test
```

## Update log
**2.1.8**
- Make `User-Agent` not optional and add the version to it.

**2.1.7**
- upgrade `axios` to `v1.6.4` (contributed by @gcagle3)

**2.1.6**
- Test node versions `14-20`
- upgrade `axios` to `v1.6.0` (contributed by @gcagle3)

**2.1.5**
- Add sourceIP as a new field to each log

**2.1.4**
- Replace from request to axios

**2.0.4**
- Add parameter to manage User-agent

**2.0.3**
- Add verbose logging to use in Azure serverless function

**2.0.2**
- Updated required fields for typescript

**2.0.1**
- Fixed sorting by nanosec-timestamp
- Added option to log string with an object
- Updated Typescript declaration for optional dependencies

**2.0.0**
- Added support for TypeScript
- End of support for node 6
- Upgrade dependencies due to security vulnerabilities

Expand to check old versions

**1.0.4 - 1.0.6**
- Upgrade dependencies due to security vulnerabilities

**1.0.3**
- Added the bulk to the callback in case the send failed

**1.0.2**
- Handle no Error code on bad requests

**1.0.1**
- ES6
- Support node greater than node 6
- Added gzip compress option
- Added internal logger option

**0.4.14**
- UDP callback bug fix + tests
- UDP close connection bug fix + tests
- ESLint

**0.4.12**
- Updated ability to add custom port

**0.4.6**
- Updated moment (v2.19.3) and request (v2.81.0) packages

**0.4.4**
- `@timestamp` and `@timestamp_nano` will no longer be overriden given a custom value by the user.

**0.4.3**
- Add the `@timestamp` field to the logs on the client's machine (and not when it reaches the server)

**0.4.1**
- Updated `request` dependency to 2.75.0

**0.4.0**
- Fixed issue #12 - added support for UDP
- Minor refactorings

**0.3.10**
- Fixed issue #17 - sendAndClose() wasn't actually closing the timer

**0.3.9**
- Added option to add a timestamp with nano second granularity

**0.3.8**
- Updated listener url
- Added `sendAndClose()` method which immediately sends the queued messages and clears the global timer
- Added option to supress error messages

**0.3.6**
- Fixed URL for github repository in package.json

**0.3.5**
- Bug fix : upon retry (in case of network error), the message gets sent forever

**0.3.4**
- Bug fix : `jsonToString()` was throwing an error in the catch()block

**0.3.2**
- Enhancement : Added option to attach extra fields to each log in a specific instance of the logger.

**0.3.1**
- Bug fix : When calling `log` with a string parameter, the object isn't constructed properly.