{"id":16714640,"url":"https://github.com/civitaspo/embulk-filter-copy","last_synced_at":"2025-04-10T06:13:46.302Z","repository":{"id":62557942,"uuid":"61561563","full_name":"civitaspo/embulk-filter-copy","owner":"civitaspo","description":null,"archived":false,"fork":false,"pushed_at":"2022-11-25T04:54:17.000Z","size":266,"stargazers_count":4,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-03-24T07:22:32.902Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Scala","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/civitaspo.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":".github/FUNDING.yml","license":"LICENSE.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null},"funding":{"github":"civitaspo"}},"created_at":"2016-06-20T16:08:18.000Z","updated_at":"2022-11-25T04:54:22.000Z","dependencies_parsed_at":"2023-01-22T15:45:58.730Z","dependency_job_id":null,"html_url":"https://github.com/civitaspo/embulk-filter-copy","commit_stats":null,"previous_names":[],"tags_count":4,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/civitaspo%2Fembulk-filter-copy","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/civitaspo%2Fembulk-filter-copy/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/civitaspo%2Fembulk-filter-copy/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/civitaspo%2Fembulk-filter-copy/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/civitaspo","download_url":"https://codeload.github.com/civitaspo/embulk-filter-copy/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248054218,"owners_count":21039951,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-12T21:06:20.441Z","updated_at":"2025-04-10T06:13:46.276Z","avatar_url":"https://github.com/civitaspo.png","language":"Scala","funding_links":["https://github.com/sponsors/civitaspo"],"categories":[],"sub_categories":[],"readme":"# Copy filter plugin for Embulk\n\n[![Release CI Status Badge](https://github.com/civitaspo/embulk-filter-copy/workflows/Release%20CI/badge.svg)](https://github.com/civitaspo/embulk-filter-copy/actions?query=workflow%3A%22Release+CI%22)\n\nCopy records and run another embulk by using them as input data source.\n\nThe Document for Japanese is [here](http://qiita.com/Civitaspo/items/da8483c28817071d90dc).\n\n## Overview\n\n* **Plugin type**: filter\n\n## Configuration\n\n- **copy**: Another embulk configurations except `in`. (array of `CopyEmbulkConfig`, optional)\n  - Either **copy** or **config** option is required.\n  - When **config** option is removed, this option become a required option.\n- **config**: [DEPRECATED: Use **copy** option] Another embulk configurations except `in`. (`CopyEmbulkConfig`, optional)\n  - ref. http://www.embulk.org/docs/built-in.html#embulk-configuration-file-format\n\n### Configuration for `CopyEmbulkConfig`\n\n- **name**: The name of the bulk load to copy. (string, optional)\n- **exec**: The embulk executor plugin configuration. (config, optional)\n  - **max_threads**: The maximum number of threads for that the bulk load runs concurrently. (int, default: The number of available CPU cores)\n- **filters**: The embulk filter plugin configurations. (array of config, default: `[]`)\n- **out**: The embulk output plugin configuration.\n\n\n## Example\n\n```yaml\nfilters:\n  - type: copy\n    copy:\n      - name: copy-01\n        filters:\n          - type: remove_columns\n            remove: [\"t\"]\n        out:\n          type: stdout\n      - exec:\n          max_threads: 4\n        filters:\n          - type: remove_columns\n            remove: [\"payload\"]\n        out:\n          type: stdout\n```\n\n## Development\n\n### Run the example\n\n```shell\n$ ./gradlew gem\n$ embulk run example/config.yml -Ibuild/gemContents/lib\n```\n\n### Run tests\n\n```shell\n$ ./gradlew scalatest\n```\n\n### Build\n\n```\n$ ./gradlew gem --write-locks  # -t to watch change of files and rebuild continuously\n```\n\n### Release gem\nFix [build.gradle](./build.gradle), then\n\n\n```shell\n$ ./gradlew gemPush\n```\n\n## CHANGELOG\n\n[CHANGELOG.md](./CHANGELOG.md)\n\n## License\n\n[MIT LICENSE](./LICENSE)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcivitaspo%2Fembulk-filter-copy","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcivitaspo%2Fembulk-filter-copy","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcivitaspo%2Fembulk-filter-copy/lists"}