{"id":17640706,"url":"https://github.com/adhityaramadhanus/inkscraper","last_synced_at":"2025-05-06T20:23:38.727Z","repository":{"id":8929949,"uuid":"60273082","full_name":"AdhityaRamadhanus/inkscraper","owner":"AdhityaRamadhanus","description":"Linkedin Jobs Scraper using nodejs,expressjs and mongodb as storage","archived":false,"fork":false,"pushed_at":"2024-09-15T02:31:26.000Z","size":913,"stargazers_count":13,"open_issues_count":34,"forks_count":4,"subscribers_count":2,"default_branch":"master","last_synced_at":"2024-10-30T08:54:08.201Z","etag":null,"topics":["expressjs","linkedin","linkedin-scraper","mongodb","nodejs"],"latest_commit_sha":null,"homepage":null,"language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/AdhityaRamadhanus.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2016-06-02T14:57:15.000Z","updated_at":"2024-04-06T11:18:59.000Z","dependencies_parsed_at":"2023-01-11T17:30:39.539Z","dependency_job_id":"a109b075-d593-4159-8ab4-b20291bb2772","html_url":"https://github.com/AdhityaRamadhanus/inkscraper","commit_stats":{"total_commits":102,"total_committers":5,"mean_commits":20.4,"dds":"0.32352941176470584","last_synced_commit":"801cb12ef39d1fd20b2b9c1e4641115957432023"},"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AdhityaRamadhanus%2Finkscraper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AdhityaRamadhanus%2Finkscraper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AdhityaRamadhanus%2Finkscraper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AdhityaRamadhanus%2Finkscraper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/AdhityaRamadhanus","download_url":"https://codeload.github.com/AdhityaRamadhanus/inkscraper/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":252762346,"owners_count":21800293,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["expressjs","linkedin","linkedin-scraper","mongodb","nodejs"],"created_at":"2024-10-23T06:05:22.516Z","updated_at":"2025-05-06T20:23:38.697Z","avatar_url":"https://github.com/AdhityaRamadhanus.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# inkscraper\n[![Build Status](https://travis-ci.org/AdhityaRamadhanus/inkscraper.svg?branch=master)](https://travis-ci.org/AdhityaRamadhanus/inkscraper) [![Dependencies Status](https://david-dm.org/adhityaramadhanus/inkscraper.svg)](https://david-dm.org/adhityaramadhanus/inkscraper) [![Code Style](https://img.shields.io/badge/code%20style-standard-green.svg)](https://github.com/feross/standard)\n\n\u003cp\u003e\n  \u003ca href=\"#installation\"\u003eInstallation\u003c/a\u003e |\n  \u003ca href=\"#documentation\"\u003eDocumentation\u003c/a\u003e |\n  \u003ca href=\"#licenses\"\u003eLicense\u003c/a\u003e\n  \u003cbr\u003e\u003cbr\u003e\n  \u003cblockquote\u003e\n  inkscraper is jobs scraper for linkedin that comes with restful api and full-text search.\n\n  Scraping linkedin jobs can be considered an infringement of linkedin TOS, use it carefully.\n\n  inkscraper currently supports:\n\n  - Scrap Listing Page (Job listing, by default this will scrape https://www.linkedin.com/jobs/view-all)\n  - Scrap Details Page (Job Details Page)\n  - Restful API for jobs scraped from linkedin\n  - Full-text search using built-in mongoose (of course built-in mongodb too)\n  \u003c/blockquote\u003e\n\u003c/p\u003e\n\nInstallation\n------------\n\n* git clone https://github.com/AdhityaRamadhanus/Linkedin-Scraper.git\n* cd Linkedin-Scraper\n* npm install\n* npm run start-apiserver\n* npm run start-scraper\n* set .env files (i'm using dotenv, see here https://www.npmjs.com/package/dotenv for documentation)\n* Example of .env\n```js\nNODE_ENV=development\n\nMONGOLAB_URI='mongodb://localhost:27017/linkedin-scraper'\nAPIDOC=true\n```\n\nDocumentation\n------------\n\n* npm install -g apidoc\n* cd Linkedin-Scraper\n* npm run gen-doc\n* add APIDOC=true in .env\n* enjoy, documentation can be found in \"/apidoc\"\n\nKnown Problems\n------------\nLike i said, scraping linkedin jobs can be considered an infringement of linkedin TOS so sometime you may get 999 status code even if you run this from your local computer\n\nLicense\n----\n\nMIT © [Adhitya Ramadhanus]\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fadhityaramadhanus%2Finkscraper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fadhityaramadhanus%2Finkscraper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fadhityaramadhanus%2Finkscraper/lists"}