https://github.com/hackersandslackers/bigquery-sqlalchemy-tutorial

:bar_chart: :arrow_right: :floppy_disk: ETL script to migrate data from BigQuery to SQL.
https://github.com/hackersandslackers/bigquery-sqlalchemy-tutorial

bigquery bigquery-sqlalchemy-tutorial databases etl mysql postgres python sql sqlalchemy tutorial

Last synced: about 1 month ago
JSON representation

:bar_chart: :arrow_right: :floppy_disk: ETL script to migrate data from BigQuery to SQL.

• Host: GitHub
• URL: https://github.com/hackersandslackers/bigquery-sqlalchemy-tutorial
• Owner: hackersandslackers
• License: mit
• Created: 2019-11-16T18:02:20.000Z (almost 5 years ago)
• Default Branch: master
• Last Pushed: 2024-08-06T19:01:10.000Z (about 2 months ago)
• Last Synced: 2024-08-06T22:34:04.947Z (about 2 months ago)
• Topics: bigquery, bigquery-sqlalchemy-tutorial, databases, etl, mysql, postgres, python, sql, sqlalchemy, tutorial
• Language: Python
• Homepage: https://hackersandslackers.com/bigquery-and-sql-databases/
• Size: 141 KB
• Stars: 17
• Watchers: 2
• Forks: 8
• Open Issues: 34
• Metadata Files:
  • Readme: README.md
  • Funding: .github/FUNDING.yml
  • License: LICENSE
  • Codeowners: .github/CODEOWNERS

Awesome Lists containing this project

• jimsghstars - hackersandslackers/bigquery-sqlalchemy-tutorial - :bar_chart: :arrow_right: :floppy_disk: ETL script to migrate data from BigQuery to SQL. (Python)

README

        
# BigQuery SQLAlchemy Tutorial

![Python](https://img.shields.io/badge/Python-v3.8-blue.svg?logo=python&longCache=true&logoColor=white&colorB=5e81ac&style=flat-square&colorA=4c566a)

![Google Cloud BigQuery](https://img.shields.io/badge/Google--Cloud--BigQuery-v^1.27.0-blue.svg?logo=Google&longCache=true&logoColor=white&colorB=5e81ac&style=flat-square&colorA=4c566a)

![PyBigQuery](https://img.shields.io/badge/PyBigQuery-v0.4.15-blue.svg?logo=Google&longCache=true&logoColor=white&colorB=5e81ac&style=flat-square&colorA=4c566a)

![SQLAlchemy](https://img.shields.io/badge/SQLAlchemy-v1.3.19-red.svg?longCache=true&style=flat-square&logo=scala&logoColor=white&colorA=4c566a&colorB=bf616a)

![PyMySQL](https://img.shields.io/badge/PyMySQL-v^0.10.0-red.svg?longCache=true&style=flat-square&logo=mysql&logoColor=white&colorA=4c566a&colorB=bf616a)

![GitHub Last Commit](https://img.shields.io/github/last-commit/google/skia.svg?style=flat-square&colorA=4c566a&colorB=a3be8c)

[![GitHub Issues](https://img.shields.io/github/issues/hackersandslackers/bigquery-sqlalchemy-tutorial.svg?style=flat-square&colorA=4c566a&colorB=ebcb8b)](https://github.com/hackersandslackers/bigquery-python-tutorial/issues)

[![GitHub Stars](https://img.shields.io/github/stars/hackersandslackers/bigquery-sqlalchemy-tutorial.svg?style=flat-square&colorB=ebcb8b&colorA=4c566a)](https://github.com/hackersandslackers/bigquery-python-tutorial/stargazers)

[![GitHub Forks](https://img.shields.io/github/forks/hackersandslackers/bigquery-sqlalchemy-tutorial.svg?style=flat-square&colorA=4c566a&colorB=ebcb8b)](https://github.com/hackersandslackers/bigquery-python-tutorial/network)

![BigQuery SQLAlchemy Tutorial](https://res-5.cloudinary.com/hackers/image/upload/q_auto:best/v1/2019/11/bigquery-sql.jpg)

Lightweight ETL script to migrate data from BigQuery to SQL databases, or vice versa. Tutorial found here: https://hackersandslackers.com/bigquery-and-sql-databases/

## Getting Started

Installation via [Pipenv](https://pipenv-fork.readthedocs.io/en/latest/):

```shell

$ git clone https://github.com/hackersandslackers/bigquery-python-tutorial.git

$ cd bigquery-sqlalchemy-tutorial

$ pipenv shell

$ pipenv update

$ python3 main.py

```

Installation via [Poetry](https://python-poetry.org/):

```shell

$ git clone https://github.com/hackersandslackers/bigquery-python-tutorial.git

$ cd bigquery-sqlalchemy-tutorial

$ poetry install

$ poetry run

```

Alternatively, try installing via `setup.py`:

```shell

$ git clone https://github.com/hackersandslackers/bigquery-python-tutorial.git

$ cd bigquery-sqlalchemy-tutorial

$ python3 setup.py install

$ python3 main.py

```

-----

**Hackers and Slackers** tutorials are free of charge. If you found this tutorial helpful, a [small donation](https://www.buymeacoffee.com/hackersslackers) would be greatly appreciated to keep us in business. All proceeds go towards coffee, and all coffee goes towards more content.