{"id":34787931,"url":"https://github.com/bryand1/indeedscraper","last_synced_at":"2026-05-20T23:39:08.605Z","repository":{"id":45442860,"uuid":"162604343","full_name":"bryand1/indeedscraper","owner":"bryand1","description":"Indeed.com scrape job postings using search terms and location","archived":false,"fork":false,"pushed_at":"2022-12-08T01:29:31.000Z","size":294,"stargazers_count":0,"open_issues_count":5,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-12-26T20:51:32.200Z","etag":null,"topics":["beautifulsoup","indeed","python","requests"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/bryand1.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2018-12-20T16:25:38.000Z","updated_at":"2018-12-21T00:38:30.000Z","dependencies_parsed_at":"2023-01-24T04:01:07.762Z","dependency_job_id":null,"html_url":"https://github.com/bryand1/indeedscraper","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/bryand1/indeedscraper","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bryand1%2Findeedscraper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bryand1%2Findeedscraper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bryand1%2Findeedscraper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bryand1%2Findeedscraper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/bryand1","download_url":"https://codeload.github.com/bryand1/indeedscraper/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bryand1%2Findeedscraper/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":33280306,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-20T15:12:43.734Z","status":"ssl_error","status_checked_at":"2026-05-20T15:12:42.300Z","response_time":356,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["beautifulsoup","indeed","python","requests"],"created_at":"2025-12-25T09:33:42.679Z","updated_at":"2026-05-20T23:39:08.575Z","avatar_url":"https://github.com/bryand1.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Indeed Job Scraper\n\n![license MIT](https://s3-us-west-1.amazonaws.com/bryand1/images/badges/license-MIT-blue.svg)\n![Python 3.6 | 3.7](https://s3-us-west-1.amazonaws.com/bryand1/images/badges/python-3.6-3.7.svg)\n\n![Indeed.com](https://github.com/bryand1/indeedscraper/blob/master/docs/gis-technician.png)\n\n![Indeed.com job search results](https://github.com/bryand1/indeedscraper/blob/master/docs/gis-techician-2.png)\n\n## Getting started\n\n```bash\ngit clone https://github.com/bryand1/indeedscraper\ncd indeedscraper\n# activate virtual environment\npip install -r requirements.txt\npython main.py \"gis technician\" [--where \"Santa Monica\"] [--out .] \\\n  [--limit 100] [--sleep] [--download | --parse] [--clean]\n```\n\n### Arguments\n\n| argument | default value | description |\n| -------- | ------------- | ----------- |\n| `what` | **required** user must provide value | search term(s) |\n| `--where` | all locations | city, state, or zip code |\n| `--out` | `.` | directory to output CSV file |\n| `--limit` | `10` | page limit |\n| `--sleep` | `2` | seconds in between http requests |\n| `--download` | `false` | only download html files, but do not parse |\n| `--parse` | `false` | only parse html files that match query |\n| `--clean` | `false` | remove html files after scraping is over |\n| `--gzip` | `on` | compress html files |\n\n### Usage\n\n```bash\n# Find job postings that match the search term\n# 'gis technician' in any location and output\n# results to the file ./gis-technician-all.csv\npython main.py \"gis technician\"\n```\n\n### Geographic search\n\n```bash\n# Find job postings that match the search term\n# 'business analyst' in 'New York' and output\n# results to the file /jobhunt/jobs.csv\npython main.py \"business analyst\" --where \"New York\" --out \"/jobhunt/jobs.csv\"\n```\n\n### Issues\n\nPlease report any issues. Feel free to fork and contribute patches. :smile:\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbryand1%2Findeedscraper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fbryand1%2Findeedscraper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbryand1%2Findeedscraper/lists"}