{"id":37747926,"url":"https://github.com/promptapi/scraper-cli","last_synced_at":"2026-01-16T14:18:51.336Z","repository":{"id":57543170,"uuid":"294000038","full_name":"promptapi/scraper-cli","owner":"promptapi","description":"CLI Tool for Prompt API's Scraper API, works for macOS, linux and windows :)","archived":false,"fork":false,"pushed_at":"2020-10-06T08:20:49.000Z","size":28,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":4,"default_branch":"main","last_synced_at":"2024-06-20T03:42:15.488Z","etag":null,"topics":["api-marketplace","cli","css-selector","css-selector-parser","data-extraction","golang-cli","image-scraper","image-scraping","linux-shell","macos-shell","promptapi","scraper","scraper-api","web-scraper","web-scraping","windows-shell"],"latest_commit_sha":null,"homepage":"https://promptapi.com/marketplace/description/scraper-api","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/promptapi.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2020-09-09T04:13:41.000Z","updated_at":"2023-09-08T18:12:14.000Z","dependencies_parsed_at":"2022-08-27T19:10:51.269Z","dependency_job_id":null,"html_url":"https://github.com/promptapi/scraper-cli","commit_stats":null,"previous_names":[],"tags_count":5,"template":false,"template_full_name":null,"purl":"pkg:github/promptapi/scraper-cli","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/promptapi%2Fscraper-cli","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/promptapi%2Fscraper-cli/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/promptapi%2Fscraper-cli/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/promptapi%2Fscraper-cli/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/promptapi","download_url":"https://codeload.github.com/promptapi/scraper-cli/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/promptapi%2Fscraper-cli/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28479371,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-16T11:59:17.896Z","status":"ssl_error","status_checked_at":"2026-01-16T11:55:55.838Z","response_time":107,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["api-marketplace","cli","css-selector","css-selector-parser","data-extraction","golang-cli","image-scraper","image-scraping","linux-shell","macos-shell","promptapi","scraper","scraper-api","web-scraper","web-scraping","windows-shell"],"created_at":"2026-01-16T14:18:51.265Z","updated_at":"2026-01-16T14:18:51.321Z","avatar_url":"https://github.com/promptapi.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"![Version](https://img.shields.io/badge/version-0.1.1-orange.svg)\n![Go](https://img.shields.io/badge/go-1.15.1-black.svg)\n[![Documentation](https://godoc.org/github.com/promptapi/scraper-cli?status.svg)](https://pkg.go.dev/github.com/promptapi/scraper-cli)\n[![Go Report Card](https://goreportcard.com/badge/github.com/promptapi/scraper-cli)](https://goreportcard.com/report/github.com/promptapi/scraper-cli)\n[![Build Status](https://travis-ci.org/promptapi/scraper-cli.svg?branch=main)](https://travis-ci.org/promptapi/scraper-cli)\n\n# Prompt API - Scraper - Command Line Interface\n\nDo you like [Scraper API][scraper-api]? Don’t you like to access this beauty\nfrom your terminal?\n\n---\n\n## Requirements\n\n1. You need to signup for [Prompt API][promptapi-signup]\n1. You need to subscribe [scraper api][scraper-api], test drive is **free!!!**\n1. You need to set `PROMPTAPI_TOKEN` environment variable after subscription.\n\nIf you have `golang` environment installed, you can fetch via\n\n```bash\n$ go get -u github.com/promptapi/scraper-cli/cmd/scraper-cli\n```\n\nOr you can download binaries from [releases][releases] page\n\n---\n\n## Usage\n\n```bash\n$ scraper-cli -h\n\nusage: scraper-cli [flags...]\n\n  scraper-cli is a command-line interface for Prompt API's Scraper API. Details\n  can be found:\n\n      https://promptapi.com/marketplace/description/scraper-api\n\n  you need to signup for Prompt API to get your PROMPTAPI_TOKEN. you can signup\n  from:\n\n      https://promptapi.com/#signup-form\n\n  application looks for PROMPTAPI_TOKEN environment variable. if you pass \n  \"token\" flag, this will override environment variable lookup.\n\n  required flag(s):\n\n  -url          web url/address to scrape\n\n\n  optional flags:\n\n  -country      2 character country code\n  -token        promptapi apikey instead of PROMPTAPI_TOKEN env-var\n  -username     for HTTP Realm auth username\n  -password     for HTTP Realm auth password\n  -cookie       URL Encoded cookie header\n  -referer      HTTP referer header\n  -selector     CSS style selector path such as: a.btn div li\n  -version      display version information\n  -header       request header(s)\n  -help, -h     display help\n\n\n  examples:\n\n  $ scraper-cli -help\n  $ scraper-cli -url \"https://promptapi.com\"\n  $ scraper-cli -url \"https://promptapi.com\" -country \"EE\"\n  $ scraper-cli -url \"https://promptapi.com\" -country \"EE\" -selector \"a.btn div li\"\n\n  $ PROMPTAPI_TOKEN=\"your-api-key\" scraper-cli -url \"https://promptapi.com\"\n  $ scraper-cli -url \"https://promptapi.com\" -token \"your-api-key\"\n  $ scraper-cli -url \"https://promptapi.com\" -token \"your-api-key\" -header \"X-Referer: https://www.google.com\"\n  $ scraper-cli -url \"https://promptapi.com\" -token \"your-api-key\" -header \"X-Referer: https://www.google.com\" -header \"X-Custom-Header: Hello\"\n```\n\n---\n\n## License\n\nThis project is licensed under MIT\n\n---\n\n## Contributer(s)\n\n* [Prompt API](https://github.com/promptapi) - Creator, maintainer\n\n---\n\n## Contribute\n\nAll PR’s are welcome!\n\n1. `fork` (https://github.com/promptapi/scraper-cli/fork)\n1. Create your `branch` (`git checkout -b my-feature`)\n1. `commit` yours (`git commit -am 'Add awesome features...'`)\n1. `push` your `branch` (`git push origin my-feature`)\n1. Than create a new **Pull Request**!\n\nThis project is intended to be a safe,\nwelcoming space for collaboration, and contributors are expected to adhere to\nthe [code of conduct][coc].\n\n---\n\n[scraper-api]:      https://promptapi.com/marketplace/description/scraper-api\n[promptapi-signup]: https://promptapi.com/#signup-form\n[coc]:              https://github.com/promptapi/scraper-cli/blob/main/CODE_OF_CONDUCT.md\n[releases]:         https://github.com/promptapi/scraper-cli/releases","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpromptapi%2Fscraper-cli","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fpromptapi%2Fscraper-cli","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpromptapi%2Fscraper-cli/lists"}