https://github.com/dflemstr/rq

Record Query - A tool for doing record analysis and transformation
https://github.com/dflemstr/rq

avro command-line-tool javascript json lodash messagepack protobuf rust toml yaml

Last synced: about 1 month ago
JSON representation

Record Query - A tool for doing record analysis and transformation

• Host: GitHub
• URL: https://github.com/dflemstr/rq
• Owner: dflemstr
• License: apache-2.0
• Created: 2016-02-20T22:45:34.000Z (over 8 years ago)
• Default Branch: master
• Last Pushed: 2023-12-21T18:27:16.000Z (11 months ago)
• Last Synced: 2024-09-30T23:01:44.354Z (about 1 month ago)
• Topics: avro, command-line-tool, javascript, json, lodash, messagepack, protobuf, rust, toml, yaml
• Language: Rust
• Homepage:
• Size: 17.7 MB
• Stars: 2,269
• Watchers: 21
• Forks: 57
• Open Issues: 39
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# `rq` [![Build Status](https://travis-ci.org/dflemstr/rq.svg?branch=master)](https://travis-ci.org/dflemstr/rq) [![Build status](https://ci.appveyor.com/api/projects/status/aq916pu1odthadeh?svg=true)](https://ci.appveyor.com/project/dflemstr/rq) [![Crates.io](https://img.shields.io/crates/v/record-query.svg)](https://crates.io/crates/record-query) [![Language (Rust)](https://img.shields.io/badge/powered_by-Rust-blue.svg)](http://www.rust-lang.org/)

**NOTE**: `rq` is in very low maintenance mode as my day job is taking up

a lot of my time.  I will try my best to merge pull requests but will

not drive active development of this crate.

**NOTE**: `rq` no longer ships with query support and a Javascript

engine is not included; instead, it focuses exclusively on format

transformation.  You can still pipe into a runtime like node.js if

you need Javascript evaluation.  Please see [this issue](https://github.com/dflemstr/rq/issues/208)

to discuss introducing a new query language.

This is the home of the tool called `rq` (record query).  It's a tool

that's used for performing queries on streams of records in various

formats.

The goal is to make ad-hoc exploration of data sets easy without

having to use more heavy-weight tools like SQL/MapReduce/custom

programs.  `rq` fills a similar niche as tools like `awk` or `sed`,

but works with structured (record) data instead of text.

It was created with love out of the best parts of Rust, and is

distributed as a dependency-free binary on many operating systems and

architectures.

## Quick links

  - [Installation](doc/installation.md) — How to install `rq`.

  - [Tutorial](doc/tutorial.md) — Learn `rq` from scratch.

  - [Protobuf](doc/protobuf.md) — Configure Protobuf specifics.

  - [Development](CONTRIBUTING.md) — Contribute to `rq`.

## Format support status

| Format                  | Read | Write |

|-------------------------|------|-------|

| Apache Avro             | ✔️    | ✔️     |

| CBOR                    | ✔️    | ✔️     |

| JSON                    | ✔️    | ✔️     |

| MessagePack             | ✔️    | ✔️     |

| Google Protocol Buffers | ✔️    | ✖️     |

| YAML                    | ✔️    | ✔️     |

| TOML                    | ✔️    | ✔️     |

| Raw (plain text)        | ✔️    | ✔️     |

| CSV                     | ✔️    | ✔️     |