{"id":26120480,"url":"https://github.com/projectbabbler/ebird-scrapers","last_synced_at":"2025-04-13T11:33:24.741Z","repository":{"id":26764649,"uuid":"100099214","full_name":"ProjectBabbler/ebird-scrapers","owner":"ProjectBabbler","description":"Functions to scrape web pages from ebird.org","archived":false,"fork":false,"pushed_at":"2025-03-03T17:24:40.000Z","size":235,"stargazers_count":10,"open_issues_count":0,"forks_count":2,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-04-12T04:36:23.637Z","etag":null,"topics":["ebird","python","scraper","website"],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ProjectBabbler.png","metadata":{"files":{"readme":"README.rst","changelog":"CHANGELOG.rst","contributing":null,"funding":null,"license":"LICENSE.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":"CITATION.cff","codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2017-08-12T08:19:24.000Z","updated_at":"2025-03-03T17:24:43.000Z","dependencies_parsed_at":"2025-03-01T15:32:02.259Z","dependency_job_id":"39b33c2c-b17f-4f44-a009-513a7247dde9","html_url":"https://github.com/ProjectBabbler/ebird-scrapers","commit_stats":null,"previous_names":["projectbabbler/ebird-pages","projectbabbler/ebird-scrapers"],"tags_count":2,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ProjectBabbler%2Febird-scrapers","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ProjectBabbler%2Febird-scrapers/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ProjectBabbler%2Febird-scrapers/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ProjectBabbler%2Febird-scrapers/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ProjectBabbler","download_url":"https://codeload.github.com/ProjectBabbler/ebird-scrapers/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248706117,"owners_count":21148642,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ebird","python","scraper","website"],"created_at":"2025-03-10T13:15:07.130Z","updated_at":"2025-04-13T11:33:24.715Z","avatar_url":"https://github.com/ProjectBabbler.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"eBird Scrapers\n==============\nAlthough eBird has an API, not all the information from the database is\navailable. The API, for example, does not return links to any uploaded\nphotos; comments on an individual observation are also missing. eBird Scrapers\nis a set of scrapers for extracting data from various pages on the eBird\nweb site. It complements the API, giving access to all the data that eBird\nmakes publicly available.\n\nInstall\n-------\n.. code-block:: console\n\n    pip install ebird-scrapers\n\nUsage\n-----\nScraping the data from a page is as simple as a function call. For example\nto get all the data from a checklist use get_checklist() and pass in the\nunique identifier generated when the checklist was submitted to the eBird\ndatabase:\n\n.. code-block:: python\n\n    from ebird.scrapers import get_checklist\n\n    data = get_checklist(\"S38429565\")\n\nThe function returns a dict with keys for the location, date, observers, etc.\n\nYou can also get the complete list of checklists from the \"Recent Checklists\"\npage, e.g. https://ebird.org/region/US-MA/recent-checklists. From there you\ncan download each checklist:\n\n.. code-block:: python\n\n    from ebird.scrapers import get_checklist, get_recent_checklists\n\n    for item in get_recent_checklists(\"US-MA\"):\n        checklist = get_checklist(item[\"identifier\"])\n\nThe data returned by ``get_checklist`` looks like this:\n\n.. code-block:: python\n\n    {\n      \"identifier\": \"S928130259\",\n      \"date\": datetime.datetime(2025, 2, 22, 10, 24),\n      \"observer\": {\n        \"identifier\": \"USER000001\",\n        \"name\": \"Etta Lemon\"\n      },\n      \"participants\": [\n        {\n          \"identifier\": \"USER000002\",\n          \"name\": \"Catherine Hall\",\n        }\n      ],\n      \"protocol\": {\n        \"name\": \"Stationary\"\n      },\n      \"location\": {\n        \"name\": \"Turkey Hill Meadow Natural Area\",\n        \"identifier\": \"L11485440\",\n        \"subnational2\": \"Tompkins County\",\n        \"subnational2_code\": \"US-NY-109\",\n        \"subnational1\": \"New York\",\n        \"subnational1_code\": \"US-NY\",\n        \"country\": \"United States\",\n        \"country_code\": \"US\",\n        \"lat\": \"42.4410439\",\n        \"lon\": \"-76.430538\"\n      },\n      \"entries\": [\n        {\n          \"species\": \"Mourning Dove\",\n          \"count\": 3,\n          \"comments\": \"Three individuals\",\n          \"media\": [\n            {\"identifier\": \"235672715\"},\n            {\"identifier\": \"235672716\"},\n            {\"identifier\": \"235672718\"}\n          ]\n        },\n        {\n          \"species\": {\n            \"common-name\": \"Red-tailed Hawk (borealis)\",\n            \"scientific-name\": \"Buteo jamaicensis borealis\",\n          },\n          \"count\": 1\n        },\n        {\n          \"species\": {\n            \"common-name\": \"European Starling\",\n            \"scientific-name\": \"Sturnus vulgaris\",\n          },\n          \"count\": 75.\n          \"comments\": \"Single flock.\",\n        },\n        {\n          \"species\": {\n            \"common-name\": \"Eastern Bluebird\",\n            \"scientific-name\": \"Sialia sialis\",\n          },\n          \"count\": 2,\n          \"breeding-code\": {\n            \"code\": 0,\n            \"name\": \"Flyover (Observed)\"\n          }\n        },\n        {\n          \"species\": {\n            \"common-name\": \"American Robin\",\n            \"scientific-name\": \"Turdus migratorius\",\n          },\n          \"count\": 24\n        },\n        {\n          \"species\": {\n            \"common-name\": \"Red-winged Blackbird (Red-winged)\",\n            \"scientific-name\": \"Agelaius phoeniceus\",\n          },\n          \"count\": 13\n          \"age-sex\": {\n            \"Age\": [\"Juvenile\", \"Immature\", \"Adult\", \"Age Unknown\"],\n            \"Male\": [0, 0, 4, 2],\n            \"Female\": [0, 0, 0, 3],\n            \"Sex Unknown\": [0, 0, 0, 4]}}\n        },\n        {\n          \"species\": {\n            \"common-name\": \"Common Grackle (Bronzed)\",\n            \"scientific-name\": \"Quiscalus quiscula versicolor\",\n          },\n          \"count\": 1\n        }\n      ],\n      \"comment\": \"Partly cloudy 39.9°F (4.4°C) Humidity: 93%Wind: SSW 4 mph (Gusts: 6.8 mph) Barometer: 29.7 in (1006 mb) Visibility: 9 miLast Update: 25 Feb 16:45\\nSubmitted from eBird for iOS, version 3.2.16\",\n      \"complete\": True\n    }\n\nProject Information\n-------------------\n* Issues: https://github.com/ProjectBabbler/ebird-scrapers/issues\n* Repository: https://github.com/ProjectBabbler/ebird-scrapers\n\nThe app is tested on Python 3.8+.\n\neBird Scrapers is released under the terms of the `MIT`_ license.\n\n.. _MIT: https://opensource.org/licenses/MIT\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fprojectbabbler%2Febird-scrapers","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fprojectbabbler%2Febird-scrapers","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fprojectbabbler%2Febird-scrapers/lists"}