{"id":21649985,"url":"https://github.com/jwc20/waasuapi","last_synced_at":"2026-01-28T14:32:38.929Z","repository":{"id":58336294,"uuid":"531280111","full_name":"jwc20/waasuapi","owner":"jwc20","description":"A scraper API for fetching available jobs from YCombinator's workatastartup.com","archived":false,"fork":false,"pushed_at":"2024-08-26T13:54:21.000Z","size":481,"stargazers_count":4,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-10-12T17:15:56.498Z","etag":null,"topics":["beautifulsoup","jobsearch","python","scraper","scraper-api","selenium"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/jwc20.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2022-08-31T22:31:31.000Z","updated_at":"2025-07-03T04:05:40.000Z","dependencies_parsed_at":"2024-03-26T16:29:25.493Z","dependency_job_id":"86cf17cb-62bc-4900-bf5b-ba80d62f7f95","html_url":"https://github.com/jwc20/waasuapi","commit_stats":null,"previous_names":["jwc20/waasuapi"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/jwc20/waasuapi","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jwc20%2Fwaasuapi","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jwc20%2Fwaasuapi/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jwc20%2Fwaasuapi/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jwc20%2Fwaasuapi/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/jwc20","download_url":"https://codeload.github.com/jwc20/waasuapi/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jwc20%2Fwaasuapi/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28846058,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-28T13:02:32.985Z","status":"ssl_error","status_checked_at":"2026-01-28T13:02:04.945Z","response_time":57,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["beautifulsoup","jobsearch","python","scraper","scraper-api","selenium"],"created_at":"2024-11-25T07:37:09.964Z","updated_at":"2026-01-28T14:32:38.908Z","avatar_url":"https://github.com/jwc20.png","language":"Python","readme":"# workatastartup-api\n\n### Install\n\nTo install, run the following commands.\n\n```\ngit@github.com:jwc20/workatastartup-api.git\ncd workatastartup-api\n```\n\n### Usage\n\nTo use the api, first setup and activate a python virtual environment (venv).\n\n```\npython3 -m venv venv\n. ./venv/bin/activate\n```\n\nInstall the requirements.\n\n```\npip3 install -r requirements.txt\n```\n\nYou can see the example of the scraper in example.py.\n\n### Log In\n\nSet your username and password.\n\n```\nusername = \"example_username\"\npassword = \"example_password\"\n```\n\nPlease update the chromedriver path in `waasu/__init__.py`. you can check by using the 'which' command in mac and linux.\n\n```python\nchrome_driver_path = '/usr/local/bin/chromedriver-linux64/chromedriver' # linux\n\nchrome_driver_path = '/opt/homebrew/bin/chromedriver' # mac (m1)\n```\n\nOnce set, create a client and log in using the following method.\n\n```\nclient = waasu.WorkAtAStartUp()\nclient.log_in(username=username, password=password)\n```\n\n### Scrape\n\nTo scrape for companies, you can add queries (keywords) and add additional filter parameters.\n\n```\nquery = [\"python\", \"javascript\", \"data\", \"typescript\"]\nclient.get_companies(query=query, jobType=\"contract\", role=\"eng\", scroll_delay=10)\n\n\n#=\u003e [\n#     {\n#         'about': 'Our mission is to take cars off the road by making it safe and easy to vanpool in the post Covid world.',\n#         'company_url': 'magicbus.io',\n#         'founders': ['Jason Kraft', 'Chris Upjohn'],\n#         'jobs': [\n#             {\n#                 'details': 'Remote fulltime  Visa Required 3+ years',\n#                 'job_name': 'Software Developer - DevOps',\n#                 'job_url': 'https://www.workatastartup.com/jobs/43098',\n#             },\n#             {\n#                 'details': 'Remote contract 6+ years',\n#                 'job_name': 'Software Developer - Frontend',\n#                 'job_url': 'https://www.workatastartup.com/jobs/16340',\n#             },\n#         ],\n#         'location': 'Los Angeles, CA',\n#         'name': 'MagicBus',\n#         'size': '18 people',\n#         'tech': \"We're working on problems related to geospatial route optimization, machine learning, and natural language processing in addition to mobile web and app development.\",\n#         'waasu_url': 'https://www.workatastartup.com/companies/magicbus',\n#     },\n#     {\n#         'about': \"Tenjin manages mobile growth infrastructure for our clients by organizing, analyzing, and securing the rush of data generated by mobile devices and marketing channels. We're reshaping mobile marketing by breaking down data silos and building an integrated data platform to replace the detached services in use today.\",\n#         'company_url': 'tenjin.com',\n#         ...\n# ]\n```\n\n### Optional Filters\n\n```\nhasEquity=(\"any\", \"true\", \"false\") (\"any\" same as \"false\")\ndemographic=(\"any\", \"black-founders\", \"women-founders\", \"latinx-founders\")\nhasSalary=(\"any\", \"true\", \"false\")\nindustry=(\"any\", \"B2B Software and Services\", \"Consumer\", \"Education\", \"Healthcare\", \"Financial Technology and Services\", \"Real Estate and Construction\", \"Industrials\", \"Government\", \"Unspecified\")\ninterviewProcess=(\"any\", \"true\", \"false\")\njobType=(\"any\", \"fulltime\", \"contract\", \"intern\")\nremote=(\"any\", \"only\", \"yes\", \"no\")\nsortBy=(\"keyword\"(default), \"recommended\", \"most_active\", \"created_desc\", \"company_created_desc\", \"size\", \"size_desc\", \"name\", \"name_desc\")\nusVisaNotRequired=(\"any\", \"true\", \"false\")\nquery=query\ncompanySize=(\"any\", \"seed\", \"small\", \"medium\", \"large\")\nexpo=(\"any\")\n```\n\n#### Roles Filters\n\nFor some roles, there are addtional role_type filters.\n\n```\nrole=(\"any\", \"eng\", \"design\", \"product\", \"science\", \"sales\", \"marketing\", \"support\", \"recruiting\", \"operations\", \"finance\", \"legal\")\n\n# role_type\n\"eng\" =\u003e role_type=(\"android\", \"be\", \"data_sci\", \"devops\", \"embedded\", \"eng_mgmt\", \"fe\", \"ios\", \"fs\", \"ml\", \"robotics\", \"qa\", \"electrical\", \"hw\", \"mechanical\", \"bio\", \"chemical\")\n\"design\" =\u003e role_type(\"web\", \"mobile\", \"ui_ux\", \"brand_graphic\", \"animation\", \"hardware\", \"user_research\", \"illustration\", \"ar_vr\", \"design_mgmt\")\n\"science\" =\u003e role_type(\"bio\", \"biotech\", \"chem\", \"genetics\", \"health\", \"immuno\", \"lab\", \"onc\", \"pharma\", \"process\", \"research\")\n```\n\n### Dependencies\n\n```\nbeautifulsoup4\nlxml\nrequests\nselenium\npprintpp\n```\n\n### See Also\n\n- [hnjobs](https://hnjobs.emilburzo.com/)\n- [Who Is Hiring?](https://kennytilton.github.io/whoishiring/)\n- [hn_search](https://news.ycombinator.com/item?id=10313519)\n- [O(n)](https://getoofn.com/)\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjwc20%2Fwaasuapi","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjwc20%2Fwaasuapi","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjwc20%2Fwaasuapi/lists"}