{"id":51260226,"url":"https://github.com/douglasdrake/mars","last_synced_at":"2026-06-29T11:32:20.523Z","repository":{"id":294297499,"uuid":"187329864","full_name":"douglasdrake/mars","owner":"douglasdrake","description":"A Flask app to scrape information about Mars","archived":false,"fork":false,"pushed_at":"2019-10-21T15:57:05.000Z","size":5672,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-05-19T19:55:55.321Z","etag":null,"topics":["beautifulsoup4","flask","mars","nasa","splinter"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/douglasdrake.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2019-05-18T07:49:46.000Z","updated_at":"2019-10-21T15:57:07.000Z","dependencies_parsed_at":"2025-05-20T19:48:27.219Z","dependency_job_id":null,"html_url":"https://github.com/douglasdrake/mars","commit_stats":null,"previous_names":["douglasdrake/mars"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/douglasdrake/mars","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/douglasdrake%2Fmars","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/douglasdrake%2Fmars/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/douglasdrake%2Fmars/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/douglasdrake%2Fmars/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/douglasdrake","download_url":"https://codeload.github.com/douglasdrake/mars/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/douglasdrake%2Fmars/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":34925718,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-06-29T02:00:05.398Z","response_time":58,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["beautifulsoup4","flask","mars","nasa","splinter"],"created_at":"2026-06-29T11:32:20.422Z","updated_at":"2026-06-29T11:32:20.517Z","avatar_url":"https://github.com/douglasdrake.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# mars\n\n# Description and Methods\n* A Flask app is provided that scrapes five sites for information and images about Mars:\n1. [NASA's Mars Exploration Program](https://mars.nasa.gov/news)\n2. [Jet Propulsion Laboaratory Mars Images](https://www.jpl.nasa.gov/spaceimages/?search=\u0026category=Mars)\n3. [Mars Weather Twitter Feed](https://twitter.com/MarsWxReport?lang=en)\n4. [Mars Facts](https://space-facts.com/mars/)\n5.  [USGS Astrogeology Center](https://astrogeology.usgs.gov)\n\n* `splinter` is used to visit the sites.\n* Beautiful Soup, `bs4`, is used to parse and scrape the sites.\n* The results of the scraping are saved in a MongoDB.\n* Finally, the results are rendered in an HTML template.\n\n`app.py` provides the Flask app and `scrape_mars.py` contains the functions used for scraping.\n\n# Results\n* [Jupyter notebook with results from 10-21-2019 scrape](https://nbviewer.jupyter.org/github/douglasdrake/mars/blob/master/scrape_mars.ipynb).\n\n\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdouglasdrake%2Fmars","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdouglasdrake%2Fmars","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdouglasdrake%2Fmars/lists"}