{"id":19572940,"url":"https://github.com/erickwendel/parallelizing-nodejs-ops","last_synced_at":"2025-04-10T01:10:26.552Z","repository":{"id":235670744,"uuid":"788097040","full_name":"ErickWendel/parallelizing-nodejs-ops","owner":"ErickWendel","description":"Example of how to Migrate 1M items from MongoDB to Postgres in just a few minutes using Node.js child process","archived":false,"fork":false,"pushed_at":"2024-05-29T20:35:21.000Z","size":28,"stargazers_count":163,"open_issues_count":3,"forks_count":82,"subscribers_count":3,"default_branch":"main","last_synced_at":"2025-04-02T22:08:29.884Z","etag":null,"topics":["child-process","docker","docker-compose","mongo","mongodb","nodejs","performance","pg","postgres","postgresql"],"latest_commit_sha":null,"homepage":"https://youtu.be/EnK8-x8L9TY","language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ErickWendel.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null}},"created_at":"2024-04-17T19:11:15.000Z","updated_at":"2025-02-01T18:38:57.000Z","dependencies_parsed_at":"2024-04-24T07:32:20.952Z","dependency_job_id":null,"html_url":"https://github.com/ErickWendel/parallelizing-nodejs-ops","commit_stats":null,"previous_names":["erickwendel/parallelizing-nodejs-ops"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ErickWendel%2Fparallelizing-nodejs-ops","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ErickWendel%2Fparallelizing-nodejs-ops/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ErickWendel%2Fparallelizing-nodejs-ops/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ErickWendel%2Fparallelizing-nodejs-ops/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ErickWendel","download_url":"https://codeload.github.com/ErickWendel/parallelizing-nodejs-ops/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248137886,"owners_count":21053775,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["child-process","docker","docker-compose","mongo","mongodb","nodejs","performance","pg","postgres","postgresql"],"created_at":"2024-11-11T06:31:02.281Z","updated_at":"2025-04-10T01:10:26.534Z","avatar_url":"https://github.com/ErickWendel.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Parallelizing Node.js operations with child process\n\nExample of [how to Migrate 1M items from MongoDB to Postgres in just a few minutes](https://youtu.be/EnK8-x8L9TY) using Node.js child process\n\n**First leave your star in the repo 🌟**\n![Aumentando em 999x a velocidade de processamento de dados com Node](https://github.com/ErickWendel/parallelizing-nodejs-ops/assets/8060102/6974de93-7848-477a-9198-9d99dedc18f3)\n\n\n## Running\n\nYou'll need to install Docker and Docker compose to be able to spin up the DBs instances, after that run:\n- docker-compose up -d\n- npm ci\n- npm run seed\n- npm start\n\n## Errors?\n\nIn case you got an error of too many processes open, try decreasing the const [CLUSTER_SIZE](https://github.com/ErickWendel/parallelizing-nodejs-ops/blob/main/src/index.js#L8C1-L8C24) variable\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ferickwendel%2Fparallelizing-nodejs-ops","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ferickwendel%2Fparallelizing-nodejs-ops","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ferickwendel%2Fparallelizing-nodejs-ops/lists"}