{"id":21404741,"url":"https://github.com/feluelle/pastebin-crawler-lib","last_synced_at":"2025-06-12T12:08:53.709Z","repository":{"id":103283689,"uuid":"77483901","full_name":"feluelle/pastebin-crawler-lib","owner":"feluelle","description":"A library for web crawling http://pastebin.com","archived":false,"fork":false,"pushed_at":"2017-11-17T20:35:33.000Z","size":12,"stargazers_count":1,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-03-16T16:48:32.559Z","etag":null,"topics":["pastebin","web-crawling"],"latest_commit_sha":null,"homepage":"","language":"C#","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/feluelle.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2016-12-27T21:32:44.000Z","updated_at":"2024-07-07T04:34:36.000Z","dependencies_parsed_at":null,"dependency_job_id":"2e40fe69-1ac6-4814-a406-4494a89aaeb9","html_url":"https://github.com/feluelle/pastebin-crawler-lib","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/feluelle/pastebin-crawler-lib","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/feluelle%2Fpastebin-crawler-lib","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/feluelle%2Fpastebin-crawler-lib/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/feluelle%2Fpastebin-crawler-lib/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/feluelle%2Fpastebin-crawler-lib/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/feluelle","download_url":"https://codeload.github.com/feluelle/pastebin-crawler-lib/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/feluelle%2Fpastebin-crawler-lib/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":259462559,"owners_count":22861512,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["pastebin","web-crawling"],"created_at":"2024-11-22T16:17:51.548Z","updated_at":"2025-06-12T12:08:53.678Z","avatar_url":"https://github.com/feluelle.png","language":"C#","funding_links":[],"categories":[],"sub_categories":[],"readme":"# PastebinCrawlerLib\nA library for web crawling http://pastebin.com\n\n## Is this legal?\nAccording to pastebin's offical website it is. \nSee http://pastebin.com/faq#17\n```\nI got blocked! Can I scrape your website?\n\nYes, but we do limit the amount of requests that people can make, \nso it is very possible that you get blocked from time to time. \nIf you want to scrape our platform more intensely, \nwe have a custom scraper API available where we can whitelist your IP, so you don't get blocked anymore. \nThis feature is only available for LIFETIME PRO users. To learn more, visit our scraping page.\n```\nSee its FAQ section http://pastebin.com/faq for more information.\n\n## ToDo\n- pastebin-crawler-lib [contains PastebinCrawler, PastebinDocument]\n\n- text-analystics-api [returns {name:string, result:ICollection}] \n\tif contains password then split by ' ' \n\tif contains email then\n\t\n- pastebin-data-sniffer (+ Filter)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffeluelle%2Fpastebin-crawler-lib","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ffeluelle%2Fpastebin-crawler-lib","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffeluelle%2Fpastebin-crawler-lib/lists"}