Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/kamatama41/embulk-output-multi
Embulk output plugin to dump records into multiple destinations.
https://github.com/kamatama41/embulk-output-multi
embulk embulk-output-plugin java
Last synced: 7 days ago
JSON representation
Embulk output plugin to dump records into multiple destinations.
- Host: GitHub
- URL: https://github.com/kamatama41/embulk-output-multi
- Owner: kamatama41
- License: mit
- Created: 2019-03-01T12:43:47.000Z (over 5 years ago)
- Default Branch: master
- Last Pushed: 2021-01-31T21:08:05.000Z (almost 4 years ago)
- Last Synced: 2024-04-23T18:14:34.721Z (7 months ago)
- Topics: embulk, embulk-output-plugin, java
- Language: Java
- Homepage:
- Size: 109 KB
- Stars: 4
- Watchers: 3
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Multi output plugin for Embulk
This plugin copies an output to multiple destinations.
### Notes
- It's still very experimental version, so might change its configuration names or styles without notification.
- As this plugin performs multiple output methods, it might have a performance issue with large records.
- It might not work on other executors than LocalExecutor.
- I would appreciate it if you use this and give me reports/feedback!
## Overview
* **Plugin type**: output
* **Load all or nothing**: no
* **Resume supported**: yes
* **Cleanup supported**: yes
## Configuration
- **outputs**: Configuration of output plugins (array, required)
## Example
```yaml
out:
type: multi
outputs:
# Output to stdout
- type: stdout
# Output to files as CSV
- type: file
path_prefix: out_file_
file_ext: csv
formatter:
type: csv
# Output to files as TSV
- type: file
path_prefix: out_file_
file_ext: tsv
formatter:
type: csv
delimiter: "\t"
# And any outputs you want..
- type: ...
```
## Build
```
$ ./gradlew gem # -t to watch change of files and rebuild continuously
```