https://github.com/hasdata/scrapeit-cloud-python-sdk

Python SDK to interact with Scrape-it Cloud API
https://github.com/hasdata/scrapeit-cloud-python-sdk

cloud proxy python scraper

Last synced: 30 days ago
JSON representation

Python SDK to interact with Scrape-it Cloud API

• Host: GitHub
• URL: https://github.com/hasdata/scrapeit-cloud-python-sdk
• Owner: HasData
• License: mit
• Created: 2022-08-11T10:05:13.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2022-10-05T18:39:36.000Z (about 2 years ago)
• Last Synced: 2024-11-07T19:08:13.994Z (about 2 months ago)
• Topics: cloud, proxy, python, scraper
• Language: Python
• Size: 5.86 KB
• Stars: 10
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Scrapeit Cloud Python SDK

[Scrapeit Cloud](https://scrape-it.cloud/) - Web Scraping API with Proxy Rotation. Get valuable data at scale in HTML format from any website without need for a proxy.

Interface to call [Scrapeit Cloud API](https://scrape-it.cloud/) easily from Python.

## Install

    pip install scrapeit-cloud

## Usage

Signup to Scrapeit Cloud to  [get your API key](https://app.scrape-it.cloud/sign-up)  and some free credits to get started.

    >>> from scrapeit_cloud import ScrapeitCloudClient

    >>>

    >>> client = ScrapeitCloudClient(api_key='INSERT_YOUR_API_KEY_HERE')

    >>>

    >>> response = client.scrape(

        params={

            "url": "https://example.com"

        }

    )

    >>>

    >>> response.text

    '{"status":"ok","scrapingResult":{"content":"\\n    Example Domain\\n\\n    \\n    \\n    \\n    \\n    body {\\n        background-color: #f0f0f2;\\n        margin: 0;\\n        padding: 0;\\n        font-family: -apple-system, system-ui, BlinkMacSystemFont, \\"Segoe UI\\", \\"Open Sans\\", \\"Helvetica Neue\\", Helvetica, Arial, sans-serif;\\n        \\n    }\\n    div {\\n        width: 600px;\\n        margin: 5em auto;\\n        padding: 2em;\\n        background-color: #fdfdff;\\n        border-radius: 0.5em;\\n        box-shadow: 2px 3px 7px 2px rgba(0,0,0,0.02);\\n    }\\n    a:link, a:visited {\\n        color: #38488f;\\n        text-decoration: none;\\n    }\\n    @media (max-width: 700px) {\\n        div {\\n            margin: 0 auto;\\n            width: auto;\\n        }\\n    }\\n        \\n\\n\\n\\n
\\n    
Example Domain
\\n    
This domain is for use in illustrative examples in documents. You may use this\\n    domain in literature without prior coordination or asking for permission.
\\n    
More information...
\\n
\\n\\n\\n","headers":{"accept-ranges":"bytes","age":"477265","cache-control":"max-age=604800","content-encoding":"gzip","content-length":"648","content-type":"text/html; charset=UTF-8","date":"Thu, 11 Aug 2022 11:56:20 GMT","etag":"\\"3147526947\\"","expires":"Thu, 18 Aug 2022 11:56:20 GMT","last-modified":"Thu, 17 Oct 2019 07:18:26 GMT","server":"ECS (nyb/1D17)","vary":"Accept-Encoding","x-cache":"HIT"},"cookies":[]}}'

    >>>


Scrapeit Cloud supports various parameters to execute a custom JavaScript script, use a premium proxy from a specific geolocation and more.

You can find all the supported parameters on [Scrapeit Cloud documentation](https://scrape-it.cloud/docs/).