{"id":23193850,"url":"https://github.com/umarwazeer/linkedin-scraper","last_synced_at":"2025-07-16T10:35:58.682Z","repository":{"id":246506140,"uuid":"818948078","full_name":"umarwazeer/linkedin-scraper","owner":"umarwazeer","description":"This project is a LinkedIn scraper that automates the login process and can search for jobs based on specified keywords and locations.","archived":false,"fork":false,"pushed_at":"2024-06-29T06:31:24.000Z","size":136,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-02-10T15:21:31.835Z","etag":null,"topics":["pyhton","selenium-webdriver"],"latest_commit_sha":null,"homepage":"","language":"HTML","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/umarwazeer.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-06-23T10:36:14.000Z","updated_at":"2024-06-30T00:53:12.000Z","dependencies_parsed_at":"2024-06-28T11:26:01.384Z","dependency_job_id":null,"html_url":"https://github.com/umarwazeer/linkedin-scraper","commit_stats":null,"previous_names":["umarwazeer/linkedin-scraper"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/umarwazeer%2Flinkedin-scraper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/umarwazeer%2Flinkedin-scraper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/umarwazeer%2Flinkedin-scraper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/umarwazeer%2Flinkedin-scraper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/umarwazeer","download_url":"https://codeload.github.com/umarwazeer/linkedin-scraper/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247305902,"owners_count":20917202,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["pyhton","selenium-webdriver"],"created_at":"2024-12-18T13:12:40.751Z","updated_at":"2025-04-05T07:41:40.030Z","avatar_url":"https://github.com/umarwazeer.png","language":"HTML","funding_links":[],"categories":[],"sub_categories":[],"readme":"# LinkedIn Jobs Scaper\n\nFirst, I do not condone scraping LinkedIn data in any way. Anyone who wishes to do so should first read LinkedIn's statement on their \u003ca href=\"https://www.linkedin.com/help/linkedin/answer/56347/prohibition-of-scraping-software?lang=en\" target=\"_blank\"\u003eprohibition of scraping software\u003c/a\u003e.\n\n\nBut if one were to scrape LinkedIn job postings using selenium webdriver with access to premium user insights, say, then this repository could serve as a collection of tools that one may find useful. I found the selenium webdriver to be key in this process, as LI dynamically renders their pages with JavaScript, so using a tool like BeautifulSoup will grab the initial JS code but not the data that is displayed on the page. Also, note that LinkedIn actively suspends accounts due to 'excessive activity' on a given account.\n\n\nThis module requires python bindings for the selenium webdriver\n```bash\n$ pip install selenium\n```\n\n\nHere is a quick demo of how one can use the LinkedIn client and scrape tools.\n\nFrom the command line:\n```bash\n$ python main.py --username uname --password pword --keyword software --location \"san francisco bay area\" --sort_by date\n```\n\nOr alter settings and run main\n```python\nfrom selenium import webdriver\nfrom client import LIClient\nfrom settings import search_keys\nimport time\n\n\n# initialize Selenium Web Driver\ndriver = webdriver.Chrome()\ndriver.get(\"https://www.linkedin.com/uas/login\")\n# initialize LinkedIn web client\nliclient = LIClient(driver, **search_keys)\nliclient.login()\n# wait for page load\ntime.sleep(3)\n\nliclient.keyword  = \"software\"\nliclient.location = \"san francisco bay area\"\nliclient.navigate_to_jobs_page()\nliclient.enter_search_keys()\nliclient.customize_search_results()\nliclient.navigate_search_results()\nliclient.driver_quit()\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fumarwazeer%2Flinkedin-scraper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fumarwazeer%2Flinkedin-scraper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fumarwazeer%2Flinkedin-scraper/lists"}