{"id":19991421,"url":"https://github.com/VAllens/CrawlerSamples","last_synced_at":"2025-05-04T10:31:34.328Z","repository":{"id":37843258,"uuid":"138837003","full_name":"VAllens/CrawlerSamples","owner":"VAllens","description":"This is a Puppeteer+AngleSharp crawler console app samples, used C# 7.1 coding and dotnet core build.","archived":false,"fork":false,"pushed_at":"2022-06-22T15:48:03.000Z","size":58,"stargazers_count":40,"open_issues_count":0,"forks_count":13,"subscribers_count":5,"default_branch":"master","last_synced_at":"2024-11-13T04:53:39.453Z","etag":null,"topics":["anglesharp","chsarp","crawler","dotnetcore","headless","headless-browsers","headless-chrome","headless-chromium","puppeteer"],"latest_commit_sha":null,"homepage":"","language":"C#","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/VAllens.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2018-06-27T06:07:47.000Z","updated_at":"2024-04-16T06:25:09.000Z","dependencies_parsed_at":"2022-08-19T13:11:23.439Z","dependency_job_id":null,"html_url":"https://github.com/VAllens/CrawlerSamples","commit_stats":null,"previous_names":[],"tags_count":2,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/VAllens%2FCrawlerSamples","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/VAllens%2FCrawlerSamples/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/VAllens%2FCrawlerSamples/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/VAllens%2FCrawlerSamples/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/VAllens","download_url":"https://codeload.github.com/VAllens/CrawlerSamples/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":252320324,"owners_count":21729106,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["anglesharp","chsarp","crawler","dotnetcore","headless","headless-browsers","headless-chrome","headless-chromium","puppeteer"],"created_at":"2024-11-13T04:51:44.927Z","updated_at":"2025-05-04T10:31:33.785Z","avatar_url":"https://github.com/VAllens.png","language":"C#","funding_links":[],"categories":["C\\#"],"sub_categories":[],"readme":"# Crawler Samples\nThis is a `PuppeteerSharp` + `AngleSharp` crawler console app samples, used `C# 7.1` coding and dotnet core build.\n\n# Useful links\n* [Puppeteer Sharp](https://github.com/kblok/puppeteer-sharp)\n* [AngleSharp](https://github.com/AngleSharp/AngleSharp)\n\n\n# Usage\nOpen this sample project in the `Visual Studio 2017` and press **`F5`** key run it.\n### Or\nOpen this sample project in the `Visual Studio 2017` and enter **`Build(B) --\u003e Publish(H)`** in the top toolbar.\n\nGo to `build\\win\\netcoreapp2.0\\x64` or `build\\win\\netcoreapp2.0\\x86` folder, run `CrawlerSamples.ConsoleApp.exe` here.\n\n\n# Result picture\n\u003cimg src=\"https://github.com/VAllens/CrawlerSamples/raw/master/SampleSnapshoot.png\" width=\"859\" height=\"453\" alt=\"Sample Snapshoot\" title=\"SampleSnapshoot\"\u003e\n\n# Note\nFor the first time, it will download the `download-Win64-536395.zip` portable installation package from the network to the .local-chromium directory of the current program.\n\nIt will some time to wait here.\n\nIf a network problem occurs during downloading, which results in download failure, it throws an exception and exits the program.\n\n\n# Author\nAuthor: [Allen](http://vallen.cnblogs.com)\n\n# License\nMIT\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FVAllens%2FCrawlerSamples","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FVAllens%2FCrawlerSamples","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FVAllens%2FCrawlerSamples/lists"}