{"id":18354488,"url":"https://github.com/alvarofpp/dataset-inmet","last_synced_at":"2025-04-10T01:25:16.399Z","repository":{"id":132916941,"uuid":"307221321","full_name":"alvarofpp/dataset-inmet","owner":"alvarofpp","description":"This repository has scripts that allow you to generate INMET datasets for public weather stations.","archived":false,"fork":false,"pushed_at":"2024-02-24T21:18:33.000Z","size":4099,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-02-15T16:49:52.900Z","etag":null,"topics":["brazil","csv","dataset","inmet","python3","weather"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/alvarofpp.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-10-26T00:25:40.000Z","updated_at":"2024-06-17T01:59:12.000Z","dependencies_parsed_at":"2024-02-24T22:37:44.275Z","dependency_job_id":null,"html_url":"https://github.com/alvarofpp/dataset-inmet","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/alvarofpp%2Fdataset-inmet","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/alvarofpp%2Fdataset-inmet/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/alvarofpp%2Fdataset-inmet/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/alvarofpp%2Fdataset-inmet/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/alvarofpp","download_url":"https://codeload.github.com/alvarofpp/dataset-inmet/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248139122,"owners_count":21054029,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["brazil","csv","dataset","inmet","python3","weather"],"created_at":"2024-11-05T22:04:14.831Z","updated_at":"2025-04-10T01:25:16.371Z","avatar_url":"https://github.com/alvarofpp.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# INMET datasets\n\nThis repository has scripts that allow you to generate INMET datasets for public weather stations.\n\n## Datasets\n\nYou can find the datasets in `data/`.\n\n### [`metadata.csv`](data/metadata.csv)\n\nWeather station data.\n\n| Column          | Type     | Description                                               | Example             |\n|-----------------|----------|-----------------------------------------------------------|---------------------|\n| region          | `string` | Region in which the weather station is located.           | `\"CO\"`              |\n| federal_unit    | `string` | Federal unit in which the weather station is located.     | `\"DF\"`              |\n| station         | `string` | Name of the weather station.                              | `\"AGUAS EMENDADAS\"` |\n| code_wmo        | `string` | WMO code of the weather station.                          | `\"A045\"`            |\n| latitude        | `float`  | Latitude of the weather station's geographical position.  | `-15.596491`        |\n| longitude       | `float`  | Longitude of the weather station's geographical position. | `-47.625801`        |\n| altitude        | `float`  | Altitude of the weather station's geographical position.  | `1030.36`           |\n| foundation_date | `date`   | Date the weather station was founded.                     | `2008-10-03`        |\n\n### [`WMO_code.csv`](data/filter_wmo/A304.csv)\n\nDataset generated after running `transform_filter_wmo.py` (e.g. `A304.csv`).\n\n| Column                             | Type      | Description                                         | Example      |\n|------------------------------------|-----------|-----------------------------------------------------|--------------|\n| date                               | `date`    | Date of record (`YYYY-MM-DD`).                      | `2003-02-24` |\n| time                               | `string`  | Time of record (`HH:mm`), UTC.                      | `\"10:00\"`    |\n| precipitation_total                | `float`   | Total precipitation (mm).                           | `0.0`        |\n| atmospheric_pressure_station_level | `float`   | Atmospheric pressure at station level, hourly (mB). | `1009.0`     |\n| atmospheric_pressure_max_before    | `float`   | Max. atmospheric pressure at time before (mB).      | `1009.0`     |\n| atmospheric_pressure_min_before    | `float`   | Min. atmospheric pressure at time before (mB).      | `1008.5`     |\n| global_radiation                   | `float`   | Global radiation (Kj/m²).                           | `1392.0`     |\n| temperature_air_dry_bulb           | `float`   | Air temperature - dry bulb, hourly (°C).            | `23.2`       |\n| temperature_dew                    | `float`   | Dew point temperature (°C).                         | `22.1`       |\n| temperature_max_before             | `float`   | Max. temperature at time before (°C).               | `23.2`       |\n| temperature_min_before             | `float`   | Min. temperature at time before (°C).               | `22.9`       |\n| temperature_dew_max_before         | `float`   | Max. dew temperature at time before (°C).           | `22.1`       |\n| temperature_dew_min_before         | `float`   | Min. dew temperature at time before (°C).           | `21.6`       |\n| humidity_relative_max_before       | `float`   | Humidity relative maximum at time before (%).       | `94.0`       |\n| humidity_relative_min_before       | `float`   | Humidity relative minimum at time before (%).       | `93.0`       |\n| humidity_relative_air              | `float`   | Relative air humidity, hourly (%).                  | `93.0`       |\n| wind_direction                     | `float`   | Wind, hourly direction (gr) (° (gr)).               | `318.0`      |\n| wind_blast                         | `float`   | Wind, maximum rain (m/s).                           | `3.5`        |\n| wind_speed                         | `float`   | Wind, time speed (m/s).                             | `1.5`        |\n| wmo_code                           | `string`  | WMO code.                                           | `\"A304\"`     |\n\n## Scripts\n\n- `extract_zip.py` - Download data from INMET.\n- `transform_zip_to_unzip.py` - Unzip the INMET zip files.\n- `transform_combine_unzip_by_year.py` - Groups all files from the same year into a single file.\n- `transform_filter_wmo.py` - Generates a file with all the records of a weather station.\n\n## Generate\n\nIn your environment:\n\n```shell\n# Install requirements for scripts\npip install -r requirements.txt\n\n# Run the scripts in this order\npython3 extract_zip.py\npython3 transform_zip_to_unzip.py\npython3 transform_combine_unzip_by_year.py\npython3 transform_filter_wmo.py\n```\n\n\u003e In `transform_filter_wmo.py`,\n  You must change the value of `code_wmo` to the WMO of the desired weather station.\n\nIf you have Docker and Makefile installed on your machine,\nyou can execute the `make build` command to create the image,\nfollowed by `make shell` to access a container and execute\nthe aforementioned steps to generate the files.\n\n## Contributing\n\nContributions are more than welcome. Fork, improve and make a pull request.\nFor bugs, ideas for improvement or other, please create an\n[issue](https://github.com/alvarofpp/dataset-inmet/issues).\n\n## License\n\nThis project is licensed under the CDLA-Sharing-1.0 License - see the [LICENSE](LICENSE)\nfile for details.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Falvarofpp%2Fdataset-inmet","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Falvarofpp%2Fdataset-inmet","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Falvarofpp%2Fdataset-inmet/lists"}