https://github.com/toddbirchard/bigquery-to-sql

:bar_chart: :arrow_right: :floppy_disk: Lightweight ETL script to migrate data from BigQuery to SQL.
https://github.com/toddbirchard/bigquery-to-sql

bigquery etl google-cloud python sql sqlalchemy

Last synced: about 4 hours ago
JSON representation

:bar_chart: :arrow_right: :floppy_disk: Lightweight ETL script to migrate data from BigQuery to SQL.

• Host: GitHub
• URL: https://github.com/toddbirchard/bigquery-to-sql
• Owner: toddbirchard
• Created: 2019-10-27T18:56:11.000Z (about 5 years ago)
• Default Branch: master
• Last Pushed: 2023-01-05T02:10:35.000Z (almost 2 years ago)
• Last Synced: 2024-05-12T00:44:37.311Z (6 months ago)
• Topics: bigquery, etl, google-cloud, python, sql, sqlalchemy
• Language: Python
• Homepage: https://hackersandslackers.com/bigquery-and-sql-databases/
• Size: 104 KB
• Stars: 2
• Watchers: 1
• Forks: 0
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • Funding: .github/FUNDING.yml

Awesome Lists containing this project

README

        
# BigQuery SQLAlchemy Tutorial

![Python](https://img.shields.io/badge/Python-v^3.7-blue.svg?logo=python&longCache=true&logoColor=white&colorB=5e81ac&style=flat-square&colorA=4c566a)

![Google Cloud BigQuery](https://img.shields.io/badge/Google--Cloud--BigQuery-v1.24.0-blue.svg?logo=Google&longCache=true&logoColor=white&colorB=5e81ac&style=flat-square&colorA=4c566a)

![PyBigQuery](https://img.shields.io/badge/PyBigQuery-v0.4.13-blue.svg?logo=Google&longCache=true&logoColor=white&colorB=5e81ac&style=flat-square&colorA=4c566a)

![SQLAlchemy](https://img.shields.io/badge/SQLAlchemy-v1.3.13-red.svg?longCache=true&style=flat-square&logo=scala&logoColor=white&colorA=4c566a&colorB=bf616a)

![PyMySQL](https://img.shields.io/badge/PyMySQL-v0.9.3-red.svg?longCache=true&style=flat-square&logo=mysql&logoColor=white&colorA=4c566a&colorB=bf616a)

![GitHub Last Commit](https://img.shields.io/github/last-commit/google/skia.svg?style=flat-square&colorA=4c566a&colorB=a3be8c)

[![GitHub Issues](https://img.shields.io/github/issues/hackersandslackers/bigquery-sqlalchemy-tutorial.svg?style=flat-square&colorA=4c566a&colorB=ebcb8b)](https://github.com/hackersandslackers/bigquery-python-tutorial/issues)

[![GitHub Stars](https://img.shields.io/github/stars/hackersandslackers/bigquery-sqlalchemy-tutorial.svg?style=flat-square&colorB=ebcb8b&colorA=4c566a)](https://github.com/hackersandslackers/bigquery-python-tutorial/stargazers)

[![GitHub Forks](https://img.shields.io/github/forks/hackersandslackers/bigquery-sqlalchemy-tutorial.svg?style=flat-square&colorA=4c566a&colorB=ebcb8b)](https://github.com/hackersandslackers/bigquery-python-tutorial/network)

![BigQuery SQLAlchemy Tutorial](https://res-5.cloudinary.com/hackers/image/upload/q_auto:best/v1/2019/11/bigquery-sql.jpg)

Lightweight ETL script to migrate data from BigQuery to SQL databases, or vice versa. Tutorial found here: https://hackersandslackers.com/bigquery-and-sql-databases/

## Getting Started

Installation via [Pipenv](https://pipenv-fork.readthedocs.io/en/latest/):

```shell

$ git clone https://github.com/hackersandslackers/bigquery-python-tutorial.git

$ cd bigquery-sqlalchemy-tutorial

$ pipenv shell

$ pipenv update

$ python3 main.py

```

Installation via [Poetry](https://python-poetry.org/):

```shell

$ git clone https://github.com/hackersandslackers/bigquery-python-tutorial.git

$ cd bigquery-sqlalchemy-tutorial

$ poetry install

$ poetry run

```

Alternatively, try installing via `setup.py`:

```shell

$ git clone https://github.com/hackersandslackers/bigquery-python-tutorial.git

$ cd bigquery-sqlalchemy-tutorial

$ python3 setup.py install

$ python3 main.py

```

-----

**Hackers and Slackers** tutorials are free of charge. If you found this tutorial helpful, a [small donation](https://www.buymeacoffee.com/hackersslackers) would be greatly appreciated to keep us in business. All proceeds go towards coffee, and all coffee goes towards more content.