Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/yisuschrist/ososedki_dl
Blazing bulk web scraper for leak sites
https://github.com/yisuschrist/ososedki_dl
bunkrr erome fapello ososedki python scraper scraping sorrymother wildskirts
Last synced: about 11 hours ago
JSON representation
Blazing bulk web scraper for leak sites
- Host: GitHub
- URL: https://github.com/yisuschrist/ososedki_dl
- Owner: YisusChrist
- License: gpl-3.0
- Created: 2024-07-29T17:07:17.000Z (4 months ago)
- Default Branch: main
- Last Pushed: 2024-11-13T17:52:25.000Z (6 days ago)
- Last Synced: 2024-11-13T18:38:44.880Z (6 days ago)
- Topics: bunkrr, erome, fapello, ososedki, python, scraper, scraping, sorrymother, wildskirts
- Language: Python
- Homepage:
- Size: 630 KB
- Stars: 2
- Watchers: 1
- Forks: 0
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
Report Bug
·
Request Feature
·
Ask Question
·
Report security bug
`ososedki_dl` is a Python app that allows you to download all the images from online albums. The program is designed to be simple and easy to use, with a command-line interface that allows you to download images from the website with a single command. Check the [Supported sites](#supported-sites) section to see the list of supported websites.
Table of Contents
- [Requirements](#requirements)
- [Installation](#installation)
- [From PyPI](#from-pypi)
- [Manual installation](#manual-installation)
- [Uninstall](#uninstall)
- [Usage](#usage)
- [Example of execution](#example-of-execution)
- [WIP: Upcoming progress bar feature for heavy files](#wip-upcoming-progress-bar-feature-for-heavy-files)
- [Supported sites](#supported-sites)
- [Contributors](#contributors)
- [How do I contribute to ososedki_dl?](#how-do-i-contribute-to-ososedki_dl)
- [License](#license)
- [Credits](#credits)
## Requirements
Here's a breakdown of the packages needed and their versions:
- [poetry](https://pypi.org/project/poetry) >= 1.7.1 (_only for manual installation_)
- [aiofiles](https://pypi.org/project/aiofiles) >= 24.1.0
- [aiohttp](https://pypi.org/project/aiohttp) >= 3.9.5
- [beautifulsoup4](https://pypi.org/project/beautifulsoup4) >= 4.12.2
- [fake-useragent](https://pypi.org/project/fake-useragent) >= 1.5.1
- [platformdirs](https://pypi.org/project/platformdirs) >= 4.2.2
- [requests](https://pypi.org/project/requests) >= 2.31.0
- [requests-pprint](https://pypi.org/project/requests-pprint) >= 1.0.1
- [rich](https://pypi.org/project/rich) >= 13.5.3
- [tldextract](https://pypi.org/project/tldextract) >= 5.1.2
- [validators](https://pypi.org/project/validators) >= 0.22.0
> [!NOTE]
> The software has been developed and tested using Python `3.12.1`. The minimum required version to run the software is Python 3.6. Although the software may work with previous versions, it is not guaranteed.
## Installation
### From PyPI
`ososedki_dl` can be installed easily as a PyPI package. Just run the following command:
```bash
pip3 install ososedki_dl
```
> [!IMPORTANT]
> For best practices and to avoid potential conflicts with your global Python environment, it is strongly recommended to install this program within a virtual environment. Avoid using the --user option for global installations. We highly recommend using [pipx](https://pypi.org/project/pipx) for a safe and isolated installation experience. Therefore, the appropriate command to install `ososedki_dl` would be:
>
> ```bash
> pipx install ososedki_dl
> ```
The program can now be ran from a terminal with the `ososedki_dl` command.
### Manual installation
If you prefer to install the program manually, follow these steps:
> [!WARNING]
> This will install the version from the latest commit, not the latest release.
1. Download the latest version of [ososedki_dl](https://github.com/YisusChrist/ososedki_dl) from this repository:
```bash
git clone https://github.com/YisusChrist/ososedki_dl
cd ososedki_dl
```
2. Install the package:
```bash
poetry install
```
3. Run the program:
```bash
poetry run ososedki_dl
```
### Uninstall
If you installed it from PyPI, you can use the following command:
```bash
pipx uninstall ososedki_dl
```
## Usage
> [!TIP]
> For more information about the usage of the program, run `ososedki_dl --help` or `ososedki_dl -h`.
The program can be run from the terminal with the `ososedki_dl` command. It will ask you to introduce the URL of the album you want to download. The program will automatically detect the domain, scrape the media (images and videos) and download them to the path specified by the user.
### Example of execution
https://github.com/user-attachments/assets/1b82d20f-1680-4cda-9021-ebd0f87a72ed
### WIP: Upcoming progress bar feature for heavy files
https://github.com/user-attachments/assets/b3a0ecfc-4c85-4513-807a-2e1981e3eb19
### Supported sites
| Domain | URL | Scrapping | Downloading |
| ------------------- | ----------------------------- | ------------------ | ------------------ |
| `eromexxx` | https://eromexxx.com | :heavy_check_mark: | :heavy_check_mark: |
| `fapello_is` | https://fapello.is | :heavy_check_mark: | :heavy_check_mark: |
| `ososedki` | https://ososedki.com | :heavy_check_mark: | :heavy_check_mark: |
| `sorrymother` | https://sorrymother.to | :heavy_check_mark: | :heavy_check_mark: |
| `wildskirts` | https://wildskirts.com | :heavy_check_mark: | :heavy_check_mark: |
| `bunkr-albums` | https://bunkr-albums.io | :heavy_check_mark: | :x:\* |
| `husvjjal_blogspot` | https://husvjjal.blogspot.com | :heavy_check_mark: | :heavy_check_mark: |
| `waifubitches` | https://waifubitches.com | :heavy_check_mark: | :heavy_check_mark: |
| `cosplayasian` | https://cosplayasian.com | :heavy_check_mark: | :heavy_check_mark: |
| `cosplayrule34` | https://cosplayrule34.com | :heavy_check_mark: | :heavy_check_mark: |
| `cosplayboobs` | https://cosplayboobs.com | :heavy_check_mark: | :heavy_check_mark: |
**\*** _The program will only scrape the media and display the URLs. You can easily pass all the URLs to the great [CyberDropDownloader](https://github.com/Jules-WinnfieldX/CyberDropDownloader) and download all of them with one command_:
```sh
cyberdrop_dl ...
```
## Contributors
### How do I contribute to ososedki_dl?
Before you participate in our delightful community, please read the [code of conduct](https://github.com/YisusChrist/.github/blob/main/CODE_OF_CONDUCT.md).
I'm far from being an expert and suspect there are many ways to improve – if you have ideas on how to make the configuration easier to maintain (and faster), don't hesitate to fork and send pull requests!
We also need people to test out pull requests. So take a look through [the open issues](https://github.com/YisusChrist/ososedki_dl/issues) and help where you can.
See [Contributing Guidelines](https://github.com/YisusChrist/.github/blob/main/CONTRIBUTING.md) for more details.
## License
`ososedki_dl` is released under the [GPL-3.0 License](https://opensource.org/license/GPL-3.0).
## Credits
This program is heavily inspired by [Jules-WinnfieldX](https://github.com/Jules-WinnfieldX)'s [CyberDropDownloader](https://github.com/Jules-WinnfieldX/CyberDropDownloader). Sadly, the project is no longer maintained, hence the creation of this project to try bring support for more websites and improve the codebase.