https://github.com/sonots/embulk-filter-ruby_pass

embulk filter plugin written in ruby to just pass records (for benchmark)
https://github.com/sonots/embulk-filter-ruby_pass

Last synced: about 2 months ago
JSON representation

embulk filter plugin written in ruby to just pass records (for benchmark)

• Host: GitHub
• URL: https://github.com/sonots/embulk-filter-ruby_pass
• Owner: sonots
• License: mit
• Created: 2015-06-22T15:22:25.000Z (over 9 years ago)
• Default Branch: master
• Last Pushed: 2015-06-23T16:24:01.000Z (over 9 years ago)
• Last Synced: 2024-10-13T08:08:51.888Z (3 months ago)
• Language: Ruby
• Homepage:
• Size: 137 KB
• Stars: 0
• Watchers: 0
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE.txt

Awesome Lists containing this project

README

        
# Ruby Pass filter plugin for Embulk

```

$ embulk gem install embulk-input-random

$ embulk run random.yml

```

```

$ embulk run -I lib example.yml

2015-06-23 11:20:35.875 +0900 [INFO] (transaction): Listing local files at directory '.' filtering filename by prefix 'sample.000.00'

2015-06-23 11:20:35.890 +0900 [INFO] (transaction): Loading files [sample.000.00.csv]

2015-06-23 11:20:36.111 +0900 [INFO] (transaction): {done:  0 / 1, running: 0}

2015-06-23 11:20:36.277 +0900 [WARN] (task-0000): Skipped line 2 (java.lang.NumberFormatException: For input string: "id"): id,name,score

2015-06-23 11:20:38.934 +0900 [INFO] (transaction): {done:  1 / 1, running: 0}

2015-06-23 11:20:38.968 +0900 [INFO] (main): Committed.

2015-06-23 11:20:38.969 +0900 [INFO] (main): Next config diff: {"in":{"last_path":"sample.000.00.csv"},"out":{}}

```

```

Committed - Loading files = 3.078 sec

```

Compare with Java version: https://github.com/sonots/embulk-filter-java_pass