https://github.com/smdmts/embulk-formatter-fast_jsonl

https://github.com/smdmts/embulk-formatter-fast_jsonl

embulk scala

Last synced: 13 days ago
JSON representation

• Host: GitHub
• URL: https://github.com/smdmts/embulk-formatter-fast_jsonl
• Owner: smdmts
• License: mit
• Created: 2017-08-03T10:49:14.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2017-08-29T09:58:26.000Z (over 7 years ago)
• Last Synced: 2024-11-12T18:19:20.015Z (about 1 month ago)
• Topics: embulk, scala
• Language: Scala
• Size: 278 KB
• Stars: 1
• Watchers: 2
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE.txt

Awesome Lists containing this project

README

        
# Fast JSONL formatter plugin for Embulk

Format json as 1 json in single line.

## Overview

* **Plugin type**: formatter

## Configuration

- **encoding**: output encoding. must be one of "UTF-8", "UTF-16LE", "UTF-32BE", "UTF-32LE" or "UTF-32BE" (string default: 'UTF-8')

- **newline**: newline character. (string default: 'LF')

    - CRLF, LF, CR

- **default_timezone**: timezone. "JST" (string default: UTC)

- **default_timestamp_format**: date format,. (string default: '%Y-%m-%d %H:%M:%S.%6N %z')

- **explode_json_columns**: json column's explode to top fields. (array default:[])

- **json_columns**:  json formatted as string column name. (array default:[])

### additional mode

- **suffix_key**: append suffix of key and value.(map Map[String,String]: {} )

## Example

```yaml

out:

  type: any output input plugin type

  formatter:

    type: fast_jsonl

    explode_json_columns: 

      - JSON_COLUMN_1

      - JSON_COLUMN_2

    suffix_key:

     append_key: append_value

```

## Run Examples

```

./gradlew classpath

embulk run example/config.yml -Ilib

```

## Build

```

$ ./gradlew gem  # -t to watch change of files and rebuild continuously

```