https://github.com/legolasvzla/python-pymongo-tests

Some stuffs done with pymongo
https://github.com/legolasvzla/python-pymongo-tests

etl mongodb postgresql psycopg2 pymongo python3

Last synced: 7 months ago
JSON representation

Some stuffs done with pymongo

• Host: GitHub
• URL: https://github.com/legolasvzla/python-pymongo-tests
• Owner: LegolasVzla
• License: mit
• Created: 2019-06-21T17:46:11.000Z (over 6 years ago)
• Default Branch: master
• Last Pushed: 2024-04-08T16:13:11.000Z (over 1 year ago)
• Last Synced: 2025-01-23T11:19:51.997Z (9 months ago)
• Topics: etl, mongodb, postgresql, psycopg2, pymongo, python3
• Language: Python
• Homepage:
• Size: 30.3 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# python-pymongo-tests

Summary

---------------

This is a repository used to migrate data from a MongoDB old system to a new PostgreSQL system, using pymongo and psycopg2 to generate ETL process scripts 

## Installation

The following steps were applied to install this project. Create virtualenv and install the requirements:

	virtualenv env --python=python3

	source env/bin/activate

	pip install -r requirements.txt

Create a **settings.ini** file, with the structure as below:

    [pgConf]

    DB_NAME=dbname

    DB_USER=user

    DB_PASS=password

    DB_HOST=host

    DB_PORT=port

    [mongoConf]

    DB_NAME=dbname

    DB_USER=user

    DB_PASS=password

    DB_HOST=port

    DB_PORT=port

## Collections and Tables Equivalences

MongoDB | PostgreSQL

-- | -- |

users | users

friends | friendships

categories | categories

tags | spot_tags, tags

reports | reports_actions

place_summaries | collections, spots_collections

spots | spots, user_actions, site_images

reports | reports_actions

## Contributions

------------------------

All work to improve performance is good

Enjoy it!