https://github.com/imgcook/pipcook-plugin-csv-data-collector

Pipcook plugin for cvs data collection.
https://github.com/imgcook/pipcook-plugin-csv-data-collector

pipcook-plugin pipcook-plugin-datacollect

Last synced: 3 days ago
JSON representation

Pipcook plugin for cvs data collection.

• Host: GitHub
• URL: https://github.com/imgcook/pipcook-plugin-csv-data-collector
• Owner: imgcook
• License: apache-2.0
• Created: 2020-08-12T11:44:49.000Z (over 4 years ago)
• Default Branch: master
• Last Pushed: 2021-03-19T19:23:31.000Z (over 3 years ago)
• Last Synced: 2024-08-02T19:01:33.928Z (4 months ago)
• Topics: pipcook-plugin, pipcook-plugin-datacollect
• Language: TypeScript
• Homepage:
• Size: 603 KB
• Stars: 0
• Watchers: 7
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • Changelog: CHANGELOG.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-imgcook - imgcook/pipcook-plugin-csv-data-collector

README

        
# @pipcook/plugins-csv-data-collect

### Description

This plugin is used to collect CSV dataset. The dataset can be used for tasks with text data, including text classification, text generation and etc.

Notice that the url given by this plugin should be a zip file. The contents inside this zip file should have following structure:

- train

  - [filename].csv

- validation*

  - [filename].csv

- test*

  - [filename].csv

> \* means optional. [filename] means this placeholder could be replaced by your own filename.

### Required Parameters

| Parameter | Type | Description |

|:----------|:-----|:------------|

|url|string|Url or path of your zip file. If it's a local file, add prefix file://|

### Optional Parameters

| Parameter | Type | Default Value | Description |

|:----------|:-----|:------|:-----|

### Example

```json

"dataCollect": {

  "package": "@pipcook/plugins-csv-data-collect",

  "params": {

    "url": "http://ai-sample.oss-cn-hangzhou.aliyuncs.com/image_classification/datasets/textClassification.zip"

  }

}

```