https://github.com/bbbbbrie/pastebin-bisque

Download all of a given user's public Pastebin pastes
https://github.com/bbbbbrie/pastebin-bisque

osint osint-python pastebin scraping web-scraping

Last synced: 27 days ago
JSON representation

Download all of a given user's public Pastebin pastes

• Host: GitHub
• URL: https://github.com/bbbbbrie/pastebin-bisque
• Owner: bbbbbrie
• License: other
• Created: 2020-02-26T13:32:44.000Z (over 4 years ago)
• Default Branch: main
• Last Pushed: 2023-10-20T00:22:23.000Z (9 months ago)
• Last Synced: 2024-04-26T11:20:46.453Z (3 months ago)
• Topics: osint, osint-python, pastebin, scraping, web-scraping
• Language: Python
• Size: 135 KB
• Stars: 23
• Watchers: 3
• Forks: 5
• Open Issues: 4
• Metadata Files:
  • Readme: README.rst
  • Changelog: CHANGELOG.rst
  • Contributing: CONTRIBUTING.rst
  • License: LICENSE
  • Authors: AUTHORS.rst

Lists

• osint_stuff_tool_collection - Pastebin-Bisque

README

        
==============

✨ Overview ✨

==============

The Pastebin Bisque is a small Python utility that uses BeautifulSoup to scrape a user's `Pastebin`_ profile. All public pastes from that user are downloaded to disk. Optionally, the pastes can be saved to a single `.zip` file.

There is no rate-limiting protection built-in. Read about the `Pastebin Request Limits`_ if you anticipate generating a large number of requests. The file name provided by the Pastebin user will be prepended with the short URL that Pastebin provides. This allows a single directory with all pastes and no duplicates and makes the original URL fairly easy to reconstruct.

.. _Pastebin: https://pastebin.com/

.. _Pastebin Request Limits: https://pastebin.com/doc_scraping_api#2

TL;DR - Scrape all public Pastebin pastes from a user.

* Free software: GNU Lesser General Public License v3 or later (LGPLv3+)

📦 Installation

===============

::

    pip install pastebin-bisque

📚 Documentation

================

https://pastebin-bisque.readthedocs.io/

💻 Development

==============

To run all the tests run::

    tox

Consider using this to run the tests in parallel:

    tox -p auto

Note, to combine the coverage data from all the tox environments run:

.. list-table::

    :widths: 10 90

    :stub-columns: 1

    - - Windows

      - ::

            set PYTEST_ADDOPTS=--cov-append

            tox

    - - Other

      - ::

            PYTEST_ADDOPTS=--cov-append tox