https://github.com/bbbbbrie/pastebin-bisque
Download all of a given user's public Pastebin pastes
https://github.com/bbbbbrie/pastebin-bisque
osint osint-python pastebin scraping web-scraping
Last synced: 9 days ago
JSON representation
Download all of a given user's public Pastebin pastes
- Host: GitHub
- URL: https://github.com/bbbbbrie/pastebin-bisque
- Owner: bbbbbrie
- License: other
- Created: 2020-02-26T13:32:44.000Z (almost 6 years ago)
- Default Branch: main
- Last Pushed: 2025-04-16T00:19:53.000Z (9 months ago)
- Last Synced: 2025-12-03T11:23:27.156Z (about 2 months ago)
- Topics: osint, osint-python, pastebin, scraping, web-scraping
- Language: Python
- Size: 171 KB
- Stars: 32
- Watchers: 2
- Forks: 5
- Open Issues: 3
-
Metadata Files:
- Readme: README.rst
- Changelog: CHANGELOG.rst
- Contributing: CONTRIBUTING.rst
- License: LICENSE
- Authors: AUTHORS.rst
Awesome Lists containing this project
- osint_stuff_tool_collection - Pastebin-Bisque
README
==============
✨ Overview ✨
==============
The Pastebin Bisque is a small Python utility that uses BeautifulSoup to scrape a user's `Pastebin`_ profile. All public pastes from that user are downloaded to disk. Optionally, the pastes can be saved to a single `.zip` file.
There is no rate-limiting protection built-in. Read about the `Pastebin Request Limits`_ if you anticipate generating a large number of requests. The file name provided by the Pastebin user will be prepended with the short URL that Pastebin provides. This allows a single directory with all pastes and no duplicates and makes the original URL fairly easy to reconstruct.
.. _Pastebin: https://pastebin.com/
.. _Pastebin Request Limits: https://pastebin.com/doc_scraping_api#2
TL;DR - Scrape all public Pastebin pastes from a user.
* Free software: GNU Lesser General Public License v3 or later (LGPLv3+)
📦 Installation
===============
::
pip install pastebin-bisque
Learn more on `PyPI `_.
ℹ️ Usage
========
::
pastebin-bisque
Specify a username:
::
pastebin-bisque --username catstestingcode
Zip the results:
::
pastebin-bisque -z
Download all of the public pastes for the `catstestingcode` user and save them in a `.zip` file:
::
pastebin-bisque --username catstestingcode -z
📚 Documentation
================
The documentation for `pastebin-bisque` is served via `Read the Docs `_ and is available at:
https://pastebin-bisque.readthedocs.io/
💻 Development
==============
🙏 Thanks for your interest in contributing to the development (and documentation) of `pastebin-bisque`. See the notes on :ref:`contributing` to learn more.
🧪 Tests
--------
This project uses `GitLab CI `_, `tox `_ and `Test PyPI `_ for testing. See `tests/test_pastebin_bisque.py`.
🏡 Local
^^^^^^^^
To run all the tests run::
tox
Consider using this to run the tests in parallel:
tox -p auto
Note, to combine the coverage data from all the tox environments run:
.. list-table::
:widths: 10 90
:stub-columns: 1
- - Windows
- ::
set PYTEST_ADDOPTS=--cov-append
tox
- - Other
- ::
PYTEST_ADDOPTS=--cov-append tox
💚 CI
^^^^^
See `.gitlab-ci.yml` for the tests that are performed via GitLab CI. You'll need to be a Maintainer to run the tests that interact with Test PyPI (or to release a new package to PyPI).