https://github.com/civitaspo/embulk-filter-left_outer_join_json_table

embulk-filter-join_file の前身。リリースしてないしメンテもしない。
https://github.com/civitaspo/embulk-filter-left_outer_join_json_table

Last synced: 3 months ago
JSON representation

embulk-filter-join_file の前身。リリースしてないしメンテもしない。

• Host: GitHub
• URL: https://github.com/civitaspo/embulk-filter-left_outer_join_json_table
• Owner: civitaspo
• License: mit
• Created: 2015-10-09T01:54:20.000Z (about 9 years ago)
• Default Branch: master
• Last Pushed: 2015-10-11T02:42:38.000Z (about 9 years ago)
• Last Synced: 2024-05-01T15:28:41.013Z (8 months ago)
• Language: Java
• Homepage:
• Size: 223 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE.txt

Awesome Lists containing this project

README

        
# Left Outer Join Json Table filter plugin for Embulk

## JSON Table means...

a json array with this format:

```

[

  {

    "id": 0,

    "name": "civitaspo"

  },

  {

    "id": 2,

    "name": "moriogai"

  },

  {

    "id": 5,

    "name": "natsume.soseki"

  }

]

```

## Overview

* **Plugin type**: filter

## Configuration

- **base_column**: a column name of data embulk loaded (hash, required)

  - **name**: name of the column

  - **type**: type of the column (see below)

  - **format**: format of the timestamp if type is timestamp

- **counter_column**: a column name of json table (string, default: `{name: id, type: long}`)

  - **name**: name of the column

  - **type**: type of the column (see below)

  - **format**: format of the timestamp if type is timestamp

- **joined_keys_prefix**: prefix added to joined json table keys (string, default: `"_joined_by_embulk_"`)

- **json_file_path**: path of json file (string, required)

- **json_columns**: required columns of json table (array of hash, required)

  - **name**: name of the column

  - **type**: type of the column (see below)

  - **format**: format of the timestamp if type is timestamp

---

**type of the column**

|name|description|

|:---|:---|

|boolean|true or false|

|long|64-bit signed integers|

|timestamp|Date and time with nano-seconds precision|

|double|64-bit floating point numbers|

|string|Strings|

## Example

```yaml

filters:

  - type: left_outer_join_json_table

    base_column: {name: name_id, type: long}

    counter_column: {name: id, type: long}

    joined_keys_prefix: _joined_by_embulk_

    json_file_path: master.json

    json_columns:

      - {name: id, type: long}

      - {name: name, type: string}

```

## Build

```

$ ./gradlew gem  # -t to watch change of files and rebuild continuously

```