Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/adriantomin/email-scraper
📧 A Python-based web scraping tool that recursively collects email addresses from websites. 🌐 It follows links to multiple pages and extracts emails using BeautifulSoup and regex.
https://github.com/adriantomin/email-scraper
automation beautifulsoup emailextractor python regex requests webscraping
Last synced: about 1 month ago
JSON representation
📧 A Python-based web scraping tool that recursively collects email addresses from websites. 🌐 It follows links to multiple pages and extracts emails using BeautifulSoup and regex.
- Host: GitHub
- URL: https://github.com/adriantomin/email-scraper
- Owner: AdrianTomin
- License: mit
- Created: 2024-09-11T04:35:37.000Z (3 months ago)
- Default Branch: main
- Last Pushed: 2024-11-04T22:25:03.000Z (about 2 months ago)
- Last Synced: 2024-11-04T23:24:50.135Z (about 2 months ago)
- Topics: automation, beautifulsoup, emailextractor, python, regex, requests, webscraping
- Language: Python
- Homepage:
- Size: 13.7 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE.md
Awesome Lists containing this project
README
# Email Scraper Tool 📧
A Python-based tool that scrapes websites to collect email addresses. Given a starting URL, this tool will recursively follow links found on the page and extract email addresses from all visited pages.
Built with:
## Features ✨
- **Recursive scraping**: Follows links on the web pages to visit multiple pages for a thorough search.
- **Email extraction**: Uses regular expressions to find and collect email addresses.
- **Easy to use**: Just enter a URL, and the tool will start scraping.
## Requirements 🛠️
- `python 3.x`
- `requests` – For making HTTP requests.
- `beautifulsoup4` – For parsing and navigating HTML.
- `lxml` – An XML/HTML parser for BeautifulSoup.
## Installation Guide 📝
### 1. Clone the repository:
```bash
git clone https://github.com/AdrianTomin/email-scraper.git
cd email-scraper
```
### 2. Set up a virtual environment (optional but recommended):
```bash
python -m venv venv
source venv/bin/activate
```
> On Windows: venv\Scripts\activate
### 3. Install dependencies:
The required libraries are listed in requirements.txt. You can install them using pip:
```bash
pip install -r requirements.txt
```
If you don't have the requirements.txt file yet, you can generate it as follows:
```bash
pip freeze > requirements.txt
```
### 4. Run the tool:
After installing the dependencies, you can run the tool by executing the following command:
```bash
python email_scraper.py
```
## Example Output 🖥️
```
[+] Enter url to scan: https://example.com
[1] Processing https://example.com
[2] Processing https://example.com/contact
Found emails:
[email protected]
[email protected]
```
## Badges
[](https://choosealicense.com/licenses/mit/)
## Authors
- [@AdrianTomin](https://www.github.com/AdrianTomin)