https://github.com/spuder/csv2influxdb

Converts a CSV file into json for influxdb
https://github.com/spuder/csv2influxdb

Last synced: 17 days ago
JSON representation

Converts a CSV file into json for influxdb

• Host: GitHub
• URL: https://github.com/spuder/csv2influxdb
• Owner: spuder
• License: mit
• Created: 2014-10-16T18:30:44.000Z (about 10 years ago)
• Default Branch: master
• Last Pushed: 2015-05-04T15:24:41.000Z (over 9 years ago)
• Last Synced: 2024-10-12T18:10:57.795Z (about 1 month ago)
• Language: Ruby
• Size: 158 KB
• Stars: 28
• Watchers: 5
• Forks: 4
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        

csv2influxdb

============

[![Gitter](https://badges.gitter.im/Join Chat.svg)](https://gitter.im/spuder/csv2influxdb?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge&utm_content=badge)

Converts a CSV file into JSON for [influxdb](http://influxdb.com/)

## Usage

Pass in `--help` for full options

    -d, --database      Influxdb database name (Required)

    -i, --in            CSV filename to read in

    -o, --out           JSON filename to output to 

    -p, --pretty        Output pretty formatted json

    -h, --help          Display this help message.

## Installation

    gem install csv2influxdb

    

or

    git clone https://github.com/spuder/csv2influxdb.git

    bundle install

    

Tested with ruby 2.0.0 on OSX, if you encounter issues with any other versions, please open a github issue

## What it does

Takes a csv:

|year|internet-explorer-usage|murders-per-capita|

|----|-----|----|

|2014|67|60|

|2015|51|55|

|2016|42|45|

Outputs json with influxdb table headers (name,columns,points)

```

{

    "name": "murders",

    "columns": [

        "year",

        "internet-explorer-usage",

        "murders-per-capita"

    ],

    "points": [

        [

            "2014",

            "67",

            "60"

        ],

        [

            "2015",

            "51",

            "55"

        ],

        [

            "2016",

            "42",

            "45"

        ]

    ]

}

```

## Examples

#####From CSV file, to JSON file

    csv2influxdb -d derp -i murders.csv -o /tmp/influxdb_murders.json

#####Use  stdin -> stdout

```

echo '"year","internet_explorer_usage","murders_per_capita"

2004,67,60

2005,51,55

2006,42,45' | csv2influxdb -d derp

{"name":"derp","columns":["year","internet_explorer_usage","murders_per_capita"],"points":[["2004","67","60"],["2005","51","55"],["2006","42","45"]]}

```

Obviously the stdin/stdout option won't work well for large amounts of data

#####Pretty

    csv2influxdb -p -d derp -i foo.csv -o /tmp/bar.json

Avoid using `-p` unnecessarily since it wastes network bandwidth

## Migrating Data

- Export data from your relational database to csv. 

- Use `csv2influxdb`to convert to json

- Use a tool like [influxdb-backup](https://github.com/eckardt/influxdb-backup) to import push to influxdb

## Why

There are plently of online csv to json converters, why not just use that one? 

I tried all the online converters ([this is the best one](http://www.convertcsv.com/csv-to-json.htm)), but none of them could quite convert a csv into json that was compatible with influxdb. (no column headers, no json with multiple keys)

###Legal

csv2influxdb is created by spuder, a fan of influxdb. It comes with no guarantee. It is a community project and is not supported nor afiliated with the creators of [influxdb](http://influxdb.com/).