https://github.com/scrapy-plugins/scrapy-feedexporter-sftp

https://github.com/scrapy-plugins/scrapy-feedexporter-sftp

Last synced: about 1 year ago
JSON representation

• Host: GitHub
• URL: https://github.com/scrapy-plugins/scrapy-feedexporter-sftp
• Owner: scrapy-plugins
• License: bsd-3-clause
• Created: 2015-12-29T17:22:19.000Z (over 10 years ago)
• Default Branch: master
• Last Pushed: 2025-02-12T17:21:23.000Z (over 1 year ago)
• Last Synced: 2025-04-07T07:52:34.905Z (about 1 year ago)
• Language: Python
• Size: 29.3 KB
• Stars: 6
• Watchers: 2
• Forks: 4
• Open Issues: 0
• Metadata Files:
  • Readme: README.rst
  • License: LICENSE

Awesome Lists containing this project

README

          
========================

scrapy-feedexporter-sftp

========================

.. image:: https://img.shields.io/pypi/v/scrapy-feedexporter-sftp.svg

   :target: https://pypi.python.org/pypi/scrapy-feedexporter-sftp

   :alt: PyPI Version

.. image:: https://img.shields.io/github/license/scrapy-plugins/scrapy-feedexporter-sftp.svg

   :target: https://github.com/scrapy-plugins/scrapy-feedexporter-sftp/blob/master/LICENSE

   :alt: License

scrapy-feedexporter-sftp is a `Scrapy Feed Exporter Storage Backend

`_

that allows you to export `Scrapy items

`_ to an SFTP server.

Using scrapy-feedexporter-sftp

==============================

Add a ``FEED_STORAGES`` to your Scrapy settings:

.. code-block:: python

    FEED_STORAGES = {"sftp": "scrapy_feedexporter_sftp.SFTPFeedStorage"}

Define your ``FEED_URI`` in Scrapy settings:

.. code-block:: python

    FEED_URI = "sftp://user:password@some.server/some/path/to/a/file"

To use a private key for authentication, use the ``FEED_STORAGE_SFTP_PKEY``

setting:

.. code-block:: python

    FEED_STORAGE_SFTP_PKEY = """

    -----BEGIN RSA PRIVATE KEY-----

    ...

    ... base64 encoded ...

    ...

    -----END RSA PRIVATE KEY-----

    """