https://github.com/toddbirchard/bigquery-to-sql

:bar_chart: :arrow_right: :floppy_disk: Lightweight ETL script to migrate data from BigQuery to SQL.
https://github.com/toddbirchard/bigquery-to-sql

bigquery etl google-cloud python sql sqlalchemy

Last synced: about 1 month ago
JSON representation

:bar_chart: :arrow_right: :floppy_disk: Lightweight ETL script to migrate data from BigQuery to SQL.

• Host: GitHub
• URL: https://github.com/toddbirchard/bigquery-to-sql
• Owner: toddbirchard
• Created: 2019-10-27T18:56:11.000Z (over 6 years ago)
• Default Branch: master
• Last Pushed: 2025-01-09T07:21:41.000Z (about 1 year ago)
• Last Synced: 2025-09-25T18:31:56.872Z (6 months ago)
• Topics: bigquery, etl, google-cloud, python, sql, sqlalchemy
• Language: Python
• Homepage: https://hackersandslackers.com/bigquery-and-sql-databases/
• Size: 106 KB
• Stars: 2
• Watchers: 0
• Forks: 0
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • Funding: .github/FUNDING.yml

Awesome Lists containing this project

README

          
# BigQuery SQLAlchemy Tutorial

![Python](https://img.shields.io/badge/Python-v^3.7-blue.svg?logo=python&longCache=true&logoColor=white&colorB=5e81ac&style=flat-square&colorA=4c566a)

![Google Cloud BigQuery](https://img.shields.io/badge/Google--Cloud--BigQuery-v1.24.0-blue.svg?logo=Google&longCache=true&logoColor=white&colorB=5e81ac&style=flat-square&colorA=4c566a)

![PyBigQuery](https://img.shields.io/badge/PyBigQuery-v0.4.13-blue.svg?logo=Google&longCache=true&logoColor=white&colorB=5e81ac&style=flat-square&colorA=4c566a)

![SQLAlchemy](https://img.shields.io/badge/SQLAlchemy-v1.3.13-red.svg?longCache=true&style=flat-square&logo=scala&logoColor=white&colorA=4c566a&colorB=bf616a)

![PyMySQL](https://img.shields.io/badge/PyMySQL-v0.9.3-red.svg?longCache=true&style=flat-square&logo=mysql&logoColor=white&colorA=4c566a&colorB=bf616a)

![GitHub Last Commit](https://img.shields.io/github/last-commit/google/skia.svg?style=flat-square&colorA=4c566a&colorB=a3be8c)

[![GitHub Issues](https://img.shields.io/github/issues/hackersandslackers/bigquery-sqlalchemy-tutorial.svg?style=flat-square&colorA=4c566a&colorB=ebcb8b)](https://github.com/hackersandslackers/bigquery-python-tutorial/issues)

[![GitHub Stars](https://img.shields.io/github/stars/hackersandslackers/bigquery-sqlalchemy-tutorial.svg?style=flat-square&colorB=ebcb8b&colorA=4c566a)](https://github.com/hackersandslackers/bigquery-python-tutorial/stargazers)

[![GitHub Forks](https://img.shields.io/github/forks/hackersandslackers/bigquery-sqlalchemy-tutorial.svg?style=flat-square&colorA=4c566a&colorB=ebcb8b)](https://github.com/hackersandslackers/bigquery-python-tutorial/network)

![BigQuery SQLAlchemy Tutorial](https://res-5.cloudinary.com/hackers/image/upload/q_auto:best/v1/2019/11/bigquery-sql.jpg)

Lightweight ETL script to migrate data from BigQuery to SQL databases, or vice versa. Tutorial found here: https://hackersandslackers.com/bigquery-and-sql-databases/

## Getting Started

**Installation via [Poetry](https://python-poetry.org/):**

```shell

$ git clone https://github.com/hackersandslackers/bigquery-python-tutorial.git

$ cd bigquery-sqlalchemy-tutorial

$ poetry install

$ poetry run

```

**Alternatively, try installing via `setup.py`:**

```shell

$ git clone https://github.com/hackersandslackers/bigquery-python-tutorial.git

$ cd bigquery-sqlalchemy-tutorial

$ python3 setup.py install

$ python3 main.py

```

-----

**Hackers and Slackers** tutorials are free of charge. If you found this tutorial helpful, a [small donation](https://www.buymeacoffee.com/hackersslackers) would be greatly appreciated to keep us in business. All proceeds go towards coffee, and all coffee goes towards more content.