{"id":13733952,"url":"https://github.com/remotesensinginfo/eodatadown","last_synced_at":"2026-02-21T13:36:21.582Z","repository":{"id":75996469,"uuid":"253608048","full_name":"remotesensinginfo/eodatadown","owner":"remotesensinginfo","description":"Automated download and processing of Earth Observation data to create a monitoring system.","archived":false,"fork":false,"pushed_at":"2025-02-03T15:59:42.000Z","size":12418,"stargazers_count":6,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-05-29T10:12:31.916Z","etag":null,"topics":["ard","database","earth","earth-observation","google-cloud","monitoring","monitoring-system","observation","remote","remote-sensing","sensing"],"latest_commit_sha":null,"homepage":"https://eodatadown.remotesensing.info","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/remotesensinginfo.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2020-04-06T20:27:30.000Z","updated_at":"2024-10-08T22:12:08.000Z","dependencies_parsed_at":"2024-01-06T09:54:23.704Z","dependency_job_id":"98e56768-7500-49db-a3ca-f5d647242fdf","html_url":"https://github.com/remotesensinginfo/eodatadown","commit_stats":{"total_commits":262,"total_committers":1,"mean_commits":262.0,"dds":0.0,"last_synced_commit":"4f009c5d51ed8e6f181fe1a5dc044c0d22cef932"},"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/remotesensinginfo/eodatadown","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/remotesensinginfo%2Feodatadown","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/remotesensinginfo%2Feodatadown/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/remotesensinginfo%2Feodatadown/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/remotesensinginfo%2Feodatadown/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/remotesensinginfo","download_url":"https://codeload.github.com/remotesensinginfo/eodatadown/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/remotesensinginfo%2Feodatadown/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29681928,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-02-21T13:29:26.630Z","status":"ssl_error","status_checked_at":"2026-02-21T13:26:50.125Z","response_time":107,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ard","database","earth","earth-observation","google-cloud","monitoring","monitoring-system","observation","remote","remote-sensing","sensing"],"created_at":"2024-08-03T03:00:51.232Z","updated_at":"2026-02-21T13:36:21.553Z","avatar_url":"https://github.com/remotesensinginfo.png","language":"Python","funding_links":[],"categories":["Remote Sensing.info"],"sub_categories":[],"readme":"# EODataDown\n\nA tool for automatically downloading Earth Observation imagery and products.\n\n## Dependencies\n\n* SQLAlchemy [http://www.sqlalchemy.org]\n* RSGISLib [http://www.rsgislib.org]\n* ARCSI [http://arcsi.remotesensing.info]\n* Requests [http://www.python-requests.org]\n* Planet [https://github.com/planetlabs/planet-client-python]\n* pycurl [http://pycurl.io]\n* wget [https://www.gnu.org/software/wget/]\n* postgresql [https://www.postgresql.org]\n* psycopg2 [http://initd.org/psycopg/]\n* Google Cloud Services [https://github.com/GoogleCloudPlatform/google-cloud-python]\n* PyYAML [https://pyyaml.org]\n\n### Google Cloud Services\nFor google cloud services the following dependencies need to installed. \n\n* google-api-core \n* google-cloud-core\n* google-auth\n* google-cloud-bigquery\n* google-cloud-storage\n\n[https://github.com/GoogleCloudPlatform/google-cloud-python]\n\n\n\n## Installation\n\nUsing conda and conda-forge the dependencies can be installed within the following command:\n\n```bash\nconda install -c conda-forge pycurl postgresql psycopg2 sqlalchemy google-cloud-storage google-cloud-bigquery arcsi wget pyyaml planet\n```\n\n## Configuration\n\nThere are a number of configuration files which need to created for the system to work\n\n### Overall System\n\nAn example is within the share directory of the source code.\n\n### Logging\n\nEODataDown uses the python logging library. A general configuration suitable for most users is installed alongside the source `\u003cinstall_path\u003e/share/eodatadown`. This can be edited or the `EDD_LOG_CFG` variable used to use a different configuration file. \n\n\n## Environmental Variables\n\n* `EDD_MAIN_CFG` - specify the location of a JSON file configuring the system.\n* `EDD_LOG_CFG` - specify the location of a JSON file configuring the python logging system.\n* `EDD_NCORES` - specify the number of cores to use when running jobs which can use multiple cores.\n\n\n## Notes for Sensors\n\n### Landsat and Sentinel-2 from Google.\nTo use this sensor you need to set up a google account and project. While the data and download is free an account is still required. See https://cloud.google.com/resource-manager/docs/creating-managing-projects\n\nDetails of the account will need to be specified in the JSON config file for the LandsatGOOG sensor.\n\n\n## Setting up Google Accounts\n\nSee the following page for setting up a project: \n\nhttps://cloud.google.com/resource-manager/docs/creating-managing-projects \n\nAnd then the following page for setting up your credentials:\n  \nhttps://cloud.google.com/bigquery/docs/reference/libraries\n\n## Setting up Postgresql Database \n\n### New database system\n\nTo initialise a database use the `initdb` command.\n\n```bash\ninitdb -D \u003cpath to data\u003e\n```\n### Start database \n\n```bash\npostgres -D \u003cpath to data\u003e\n```\nAlternatively, you can start the database as a background service.\n```bash\npg_ctl -D \u003cpath to data\u003e -l logfile start\n```\n\n### Create database\n\n```bash \ncreatedb eodd_dev_db\n```\n\n### Setup User\n\n```bash \npsql\n```\n\n```SQL\nCREATE USER eodduser WITH PASSWORD '\u003cpassword\u003e';\nGRANT ALL PRIVILEGES ON DATABASE eodd_dev_db TO eodduser;\n\n```\n\n\n\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fremotesensinginfo%2Feodatadown","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fremotesensinginfo%2Feodatadown","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fremotesensinginfo%2Feodatadown/lists"}