{"id":28303539,"url":"https://github.com/arverma/towardsdataengineering","last_synced_at":"2025-09-02T13:39:29.608Z","repository":{"id":39662105,"uuid":"231555209","full_name":"arverma/TowardsDataEngineering","owner":"arverma","description":"This repo contains commands that data engineers use in day to day work.","archived":false,"fork":false,"pushed_at":"2023-02-04T18:21:45.000Z","size":83,"stargazers_count":61,"open_issues_count":7,"forks_count":43,"subscribers_count":4,"default_branch":"master","last_synced_at":"2025-05-31T08:53:31.280Z","etag":null,"topics":["aws","data-engineering","devops","docker","eks","hacktoberfest","hacktoberfest2020","linux","pyspark","python","terraform"],"latest_commit_sha":null,"homepage":"https://medium.com/towards-data-engineering","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/arverma.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2020-01-03T09:28:18.000Z","updated_at":"2025-05-24T16:04:23.000Z","dependencies_parsed_at":"2023-02-18T18:30:38.078Z","dependency_job_id":null,"html_url":"https://github.com/arverma/TowardsDataEngineering","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/arverma/TowardsDataEngineering","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arverma%2FTowardsDataEngineering","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arverma%2FTowardsDataEngineering/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arverma%2FTowardsDataEngineering/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arverma%2FTowardsDataEngineering/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/arverma","download_url":"https://codeload.github.com/arverma/TowardsDataEngineering/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arverma%2FTowardsDataEngineering/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":260096618,"owners_count":22958083,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["aws","data-engineering","devops","docker","eks","hacktoberfest","hacktoberfest2020","linux","pyspark","python","terraform"],"created_at":"2025-05-23T23:11:22.369Z","updated_at":"2025-06-16T04:31:25.120Z","avatar_url":"https://github.com/arverma.png","language":"Python","readme":"# Data Enginner's Essential Commands\n\n* Linux: [Link](Linux.md)\n* Python: [Link](Python.md)\n* PySpark: [Link](PySpark.md)\n* AWS: [Link](AWS)\n    * EKS: [Link](AWS/EKS.md)\n    * EMR: [Link](AWS/EMR.md)\n    * S3: [Link](AWS/S3.md)\n* Terraform: [Link](terraform.md)\n* Git: [Link](Git.md)\n* Helm: [Link](Helm)\n    * Jupyterhub: [Link](Helm/Jupyterhub.md)\n\n---   \n\u003cdetails\u003e\u003csummary\u003eWant to contribute?\u003c/summary\u003e\n\u003cp\u003e\n\n* The commands should not be copy-pasted from any source in bulk.\n* Only add those commands that you use more frequently but may be unknown to other developers.\n\nExample: `pwd`, `ls` e.t.c., are not allowed\n* Follow the structure and don't forget to embed any reference links either in heading or command description.\n    * Put it inside a directory if applicable\n    * Give a proper heading\n    * Use markdown script for [block code or inline code]((https://github.com/adam-p/markdown-here/wiki/Markdown-Here-Cheatsheet#code)) to embed commands\n* If the command heading is not sufficient to explain the uses, give 1 liner explanation with an example.\n* I would be happy to accept your pull request even if you add `one` good command than adding `ten` not so good commands.\n\u003c/p\u003e\n\u003c/details\u003e\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Farverma%2Ftowardsdataengineering","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Farverma%2Ftowardsdataengineering","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Farverma%2Ftowardsdataengineering/lists"}