Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/lysagxra/eromedownloader
Erome albums and profile downloader
https://github.com/lysagxra/eromedownloader
bulk bulk-downloader concurrent-processing crawler downloader erome erome-downloader parallel-processing profile-downloader python python3
Last synced: about 7 hours ago
JSON representation
Erome albums and profile downloader
- Host: GitHub
- URL: https://github.com/lysagxra/eromedownloader
- Owner: Lysagxra
- License: gpl-3.0
- Created: 2024-10-23T11:53:56.000Z (25 days ago)
- Default Branch: main
- Last Pushed: 2024-11-12T22:50:34.000Z (4 days ago)
- Last Synced: 2024-11-12T23:29:20.446Z (4 days ago)
- Topics: bulk, bulk-downloader, concurrent-processing, crawler, downloader, erome, erome-downloader, parallel-processing, profile-downloader, python, python3
- Language: Python
- Homepage:
- Size: 742 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Erome Downloader
> A Python-based tool for downloading Erome albums. This project includes functionality to extract album links from user profiles and download them efficiently.
## Features
- Extracts album links from user profiles.
- Downloads multiple files concurrently from albums.
- Supports batch downloading via a list of URLs.
- Tracks download progress with a progress bar.
- Automatically creates a directory structure for organized storage.
## Dependencies
- Python 3
- `requests` - for HTTP requests
- `BeautifulSoup` (bs4) - for HTML parsing
- `rich` - for progress display in terminal
## Directory Structure
```
project-root/
├── helpers/
│ ├── download_utils.py # Utilities for managing the download process
│ ├── erome_utils.py # Functions for validating and processing Erome album URLs.
│ ├── file_utils.py # Utilities for managing file operations
│ ├── general_utils.py # Miscellaneous utility functions
│ ├── profile_crawler.py # Module to crawl profiles for album links
│ └── progress_utils.py # Tools for progress tracking and reporting
├── album_downloader.py # Module for downloading albums
├── main.py # Main script to run the downloader
├── profile_dump.txt # Log file for recording session details
└── URLs.txt # Text file containing album URLs
```
## Installation
1. Clone the repository:
```bash
git clone https://github.com/Lysagxra/EromeDownloader.git
```
2. Navigate to the project directory:
```bash
cd EromeDownloader
```
3. Install the required dependencies:
```bash
pip install -r requirements.txt
```
## Batch Download
To batch download from multiple album URLs, you can use the `main.py` script. This script reads URLs from a file named `URLs.txt` and downloads each one using the album downloader.
### Usage
1. Create a `URLs.txt` file in the project root and list the album URLs you want to download.
2. Run the main script via the command line:
```
python3 main.py
```
The downloaded files will be saved in the `Downloads` directory.
## Profile Crawler and Downloader
To download all the albums from a profile page, you can use the `-p` option.
### Usage
Use the `-p` option if you want to extract album links from a specific profile:
```bash
python3 main.py [-p ]
```
### Example
```
python3 main.py -p https://www.erome.com/marieanita
```
The downloaded files will be saved in `Downloads/` directory, where `` is the profile name extracted from the page.