{"id":25678396,"url":"https://github.com/samuelarogbonlo/data-wrangling","last_synced_at":"2026-05-19T14:05:01.339Z","repository":{"id":122302926,"uuid":"340671776","full_name":"samuelarogbonlo/data-wrangling","owner":"samuelarogbonlo","description":"Describes data-wrangling for CSV files","archived":false,"fork":false,"pushed_at":"2021-02-22T21:43:29.000Z","size":87,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-02-24T15:59:55.666Z","etag":null,"topics":["csv-files","d3js","data-visualization","data-wrangling","python3","vscode"],"latest_commit_sha":null,"homepage":"https://www.eia.gov/dnav/ng/hist/rngwhhdm.htm","language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/samuelarogbonlo.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-02-20T14:19:02.000Z","updated_at":"2021-02-22T21:43:32.000Z","dependencies_parsed_at":null,"dependency_job_id":"53aff8ef-8577-452a-b331-7b12482aae89","html_url":"https://github.com/samuelarogbonlo/data-wrangling","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/samuelarogbonlo/data-wrangling","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/samuelarogbonlo%2Fdata-wrangling","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/samuelarogbonlo%2Fdata-wrangling/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/samuelarogbonlo%2Fdata-wrangling/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/samuelarogbonlo%2Fdata-wrangling/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/samuelarogbonlo","download_url":"https://codeload.github.com/samuelarogbonlo/data-wrangling/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/samuelarogbonlo%2Fdata-wrangling/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":266120459,"owners_count":23879323,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["csv-files","d3js","data-visualization","data-wrangling","python3","vscode"],"created_at":"2025-02-24T15:48:58.584Z","updated_at":"2025-10-13T23:06:09.019Z","avatar_url":"https://github.com/samuelarogbonlo.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Data Wrangling Implementation\n\nThis repository displays how a python script could be used to generate a section of a raw ```csv``` file from (https://www.eia.gov/dnav/ng/hist/rngwhhdm.htm). \n\nOver the years, it has become increasingly difficult to process data files in ```csv``` ormat to read, parse and process the contents because engineers and analyst have to always copy and paste data into Excel/Google Docs by hand, and then export the CSV. But that would be tedious, time consuming and error prone to do month after month. This is why a script is needed to automate this process with respect to the original ```csv``` file in this case while using all the required libraries as well. \n\nThe original file has the rates and dates for the gas prices but the resulting ```csv``` files sort them out in ascending order, required rates, months details and other relevant information.\n\n\n## Core Structure\n    PYTEST\n      ├── Data\n      │   ├── datapackage.json\n      │   │\n      │   ├── gas-details_day.csv\n      │   ├── gas-details_month.csv\n      │   │\n      │   └── gas-details_year.csv\n      │   └── README.md\n      │   \n      │\n      ├── Data Visualization\n      │   ├── index.css\n      │   ├── index.html\n      │   └── index.js\n      │\n      ├── Henry_Hub_Natural_Gas_Spot_Price.csv\n      │  \n      ├── package-lock.json\n      │  \n      ├── main.py\n      │\n      └── README.md (you are here)\n\n# Stack\nPython \nPandas\nJSON\nComma Seperated Values (```csv```)\n\n# Running The Program\n- Install required dependencies for python, pandas and the likes.\n- Clone repository ```git clone (https://github.com/samuelarogbonlo/data-wrangling.git)```\n- Enter the root directory and enter ```python3 main.py``` to confirm the ```csv``` extraction or else you could study the previously generated ```csv``` file in the ```data``` directory.\n- For the data visualization, you can just open the ```index.html``` on your browser (prefferbly chrome) to load the chart (this part is challenging and still in progress).\n\n## Authors\nSamuel Arogbonlo - [Github](https://github.com/samuelarogbonlo). [Twitter](https://twitter.com/SamuelArogbonlo)\n \n## Resources and Inspirations\nStudy materials on data wrangling, visualization and ```csv``` manipulation.\n\n## Hire Me\nLooking for an SRE(DevOps) Engineer to build your next infrastruture to work remotely on your data platform in Datopian? Get in touch: (sbayo971@gmail.com)\n\n## License \nThe MIT License (http://www.opensource.org/licenses/mit-license.php)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsamuelarogbonlo%2Fdata-wrangling","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsamuelarogbonlo%2Fdata-wrangling","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsamuelarogbonlo%2Fdata-wrangling/lists"}