Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/dchrastil/ScrapedIn
A tool to scrape LinkedIn without API restrictions for data reconnaissance
https://github.com/dchrastil/ScrapedIn
Last synced: 11 days ago
JSON representation
A tool to scrape LinkedIn without API restrictions for data reconnaissance
- Host: GitHub
- URL: https://github.com/dchrastil/ScrapedIn
- Owner: dchrastil
- Created: 2018-03-29T12:41:24.000Z (about 6 years ago)
- Default Branch: master
- Last Pushed: 2024-02-21T20:12:05.000Z (4 months ago)
- Last Synced: 2024-02-27T08:35:36.045Z (4 months ago)
- Language: Python
- Size: 2.71 MB
- Stars: 887
- Watchers: 25
- Forks: 119
- Open Issues: 6
-
Metadata Files:
- Readme: README.md
Lists
- awesome-stars - dchrastil/ScrapedIn - A tool to scrape LinkedIn without API restrictions for data reconnaissance (Python)
- starred-awesome - ScrapedIn - A tool to scrape LinkedIn without API restrictions for data reconnaissance (Python)
README
# ScrapedIn
Tool to scrape LinkedIn
This tool assists in performing reconnaissance using the LinkedIn.com website/API for red team or social engineering engagements. It performs a company specific search to extract a detailed list of employees who work for the target company. Enter the name of the target company and the tool will help determine the LinkedIn company ID, which will be used to perform the search.
**NOTE:** The tool extracts the maximum results of any search (1,000 contacts) by sendings less than 20 requests.
Output is stored as an XLSX file, however it is intended to be used with Google Spreadsheets and includes a formated report with profile pictures, etc. After importing the XLSX into Google Spreadsheets there will be a "dataset" worksheet and a "report" worksheet.
## How to install
```
sudo apt-get install python3-pip -y
sudo pip install -r requirements.txt
```
## How to run
```
export LI_USERNAME={username}
export LI_PASSWORD={password}
```
`python3 ScrapedIn.py`
[ScrapedIn Demo.webm](https://github.com/dchrastil/ScrapedIn/assets/26440487/6f7888f9-2fe3-49d7-b6a3-229e508a9da3)
## dataset
- first name
- last name
- occupation
- location
- industry
- profile URL
- picture URL
## report
- Picture (displayed)
- Full Name, Occupation
- Link to Profile
## Sponsorship
[
](https://nubela.co/proxycurl?utm_campaign=influencer_marketing&utm_source=github&utm_medium=social&utm_content=daniel_chrastil_scrapedin)
> Scrape public LinkedIn profile data at scale with [Proxycurl APIs](https://nubela.co/proxycurl?utm_campaign=influencer_marketing&utm_source=github&utm_medium=social&utm_content=daniel_chrastil_scrapedin).
> - Scraping Public profiles are battle-tested in court in HiQ VS LinkedIn case.
> - GDPR, CCPA, SOC2 compliant
> - High rate Limit - 300 requests/minute
> - Fast APIs respond in ~2s
> - Fresh data - 88% of data is scraped real-time, other 12% are not older than 29 days
> - High accuracy
> - Tons of data points returned per profile
>
> Built for developers, by developers.
### Disclaimer
this tool is for educational purposes only and violates LinkedIn.com's TOS. Use at your own risk.