https://github.com/stav/linkedin-crawler
Crawl the Sales Navigator
https://github.com/stav/linkedin-crawler
Last synced: 8 months ago
JSON representation
Crawl the Sales Navigator
- Host: GitHub
- URL: https://github.com/stav/linkedin-crawler
- Owner: stav
- Created: 2025-05-07T12:50:02.000Z (about 1 year ago)
- Default Branch: master
- Last Pushed: 2025-05-10T16:11:52.000Z (about 1 year ago)
- Last Synced: 2025-10-09T11:51:50.734Z (8 months ago)
- Language: TypeScript
- Size: 78.1 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# LinkedIn Crawler
A Playwright-based crawler for LinkedIn that allows you to search for people and extract their profile information.
## Setup
1. Install dependencies:
```bash
bun install
```
2. Create a `.env` file in the root directory with your LinkedIn credentials:
```
LINKEDIN_EMAIL=your_email@example.com
LINKEDIN_PASSWORD=your_password
```
3. Install Playwright browsers:
```bash
bunx playwright install chromium
```
## Usage
Run the crawler:
```bash
bun start
```
The crawler will:
1. Launch a browser window
2. Log in to LinkedIn using your credentials
3. Search for people matching the specified keyword
4. Extract and display the search results
## Features
- Automated LinkedIn login
- People search functionality
- Profile information extraction
- Error handling and graceful cleanup
## Notes
- The crawler runs in non-headless mode by default so you can see what's happening
- Be mindful of LinkedIn's rate limits and terms of service
- Consider adding delays between actions to avoid being blocked