https://github.com/jmaupetit/data7

⚡ Open your data in minutes
https://github.com/jmaupetit/data7

csv database datasets http parquet sql

Last synced: 3 months ago
JSON representation

⚡ Open your data in minutes

• Host: GitHub
• URL: https://github.com/jmaupetit/data7
• Owner: jmaupetit
• License: mit
• Created: 2024-06-19T19:55:38.000Z (8 months ago)
• Default Branch: main
• Last Pushed: 2024-10-17T09:42:17.000Z (4 months ago)
• Last Synced: 2024-10-19T13:06:50.965Z (3 months ago)
• Topics: csv, database, datasets, http, parquet, sql
• Language: Python
• Homepage: https://jmaupetit.github.io/data7/
• Size: 1.13 MB
• Stars: 2
• Watchers: 1
• Forks: 0
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • Changelog: CHANGELOG.md
  • License: LICENSE
  • Code of conduct: docs/code_of_conduct.md

Awesome Lists containing this project

README

        
# Data7 ⚡ Open your data in minutes

> Pronounced data·set (**7** like **sept** in French).

![GitHub Actions Workflow Status](https://img.shields.io/github/actions/workflow/status/jmaupetit/data7/quality.yml)

![PyPI - Version](https://img.shields.io/pypi/v/data7)

## The idea 💡

**TL;DR** Data7 is a high performance web server that generates dynamic datasets

(in [CSV](https://en.wikipedia.org/wiki/Comma-separated_values) or

[Parquet](https://en.wikipedia.org/wiki/Apache_Parquet) formats) from existing

databases and streams them over HTTP 🎉

## A quick example

Let say you have a `restaurant` table in your PostgreSQL database, and you want

to make this table an always-up-to-date dataset that can be easily used by the

rest of the world.

All you have to do is to initialize your project:

```sh

data7 init

```

✍️ Edit configuration files:

```yaml

# settings.yaml

production:

  host: "https://data7.wonderful-places.org"

  port: 80

# .secrets.yaml

production:

  DATABASE_URL: "postgresql+asyncpg://user:pass@server:port/wonderful-places"

# data7.yaml

production:

  datasets:

    - basename: restaurants

      query: "SELECT * FROM restaurant"

```

🏎️ Fire up the `data7` server:

```sh

data7 run

```

💥 Your dataset is available at:

- [https://data7.wonderful-places.org/d/restaurants.csv](https://data7.wonderful-places.org/d/restaurants.csv)

  (CSV)

- [https://data7.wonderful-places.org/d/restaurants.parquet](https://data7.wonderful-places.org/d/restaurants.parquet)

  (Parquet)

## Documentation

The complete documentation of the project is avaiable at:

[https://jmaupetit.github.io/data7/](https://jmaupetit.github.io/data7/)

## License

This work is released under the MIT License.