An open API service indexing awesome lists of open source software.

https://github.com/fullerzz/gurlon

Gurlon is a Python library designed to simply exporting DynamoDB table to your local filesystem in order to run SQL queries. 🏗 Early in development 🚧
https://github.com/fullerzz/gurlon

duckdb dynamodb dynamodb-export python s3 sqlmodel

Last synced: 4 months ago
JSON representation

Gurlon is a Python library designed to simply exporting DynamoDB table to your local filesystem in order to run SQL queries. 🏗 Early in development 🚧

Awesome Lists containing this project

README

          

# gurlon

## Overview

`gurlon` is a library designed to make the process of exporting data from Dynamo to your local filesystem easier.

There are 3 main steps to the `gurlon` export process:

1. Instantiate a new `DataExporter` and invoke `export_data` to begin a DynamoDB PointInTimeExport to S3
2. Call the `DataExporter` function `download_data` once the DynamoDB export is complete to combine the exported data into a single json file on your local filesystem
3. Transform your local copy of the exported table data into another storage format: `csv`, `parquet`

## Comprehensive Documentation

Full docs are available here: [https://fullerzz.github.io/gurlon/](https://fullerzz.github.io/gurlon/)