{"id":25182105,"url":"https://github.com/ductnn/curls","last_synced_at":"2025-04-04T06:23:26.069Z","repository":{"id":50515374,"uuid":"519302619","full_name":"ductnn/cUrls","owner":"ductnn","description":"Simple tool crawler URLs form domain","archived":false,"fork":false,"pushed_at":"2022-07-30T11:05:10.000Z","size":10,"stargazers_count":2,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-02-09T17:35:52.562Z","etag":null,"topics":["colly","crawler","domain","golang","scanning","url"],"latest_commit_sha":null,"homepage":"","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ductnn.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"license","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2022-07-29T17:47:28.000Z","updated_at":"2024-04-02T17:43:04.000Z","dependencies_parsed_at":"2022-08-23T01:11:19.953Z","dependency_job_id":null,"html_url":"https://github.com/ductnn/cUrls","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ductnn%2FcUrls","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ductnn%2FcUrls/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ductnn%2FcUrls/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ductnn%2FcUrls/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ductnn","download_url":"https://codeload.github.com/ductnn/cUrls/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247130200,"owners_count":20888540,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["colly","crawler","domain","golang","scanning","url"],"created_at":"2025-02-09T17:29:48.762Z","updated_at":"2025-04-04T06:23:26.047Z","avatar_url":"https://github.com/ductnn.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"# cUrls\n\n[![PRs Welcome](https://img.shields.io/badge/PRs-welcome-brightgreen.svg?style=flat-square)](https://github.com/ductnn/cUrls/pulls)\n[![license](https://img.shields.io/badge/license-MIT-blue.svg)](LICENSE)\n\n**cUrls** is a simple tool crawl urls from domain using [colly](https://github.com/gocolly/colly)\nlibrary.\n\n## Installation\n\nFirst, install [golang](https://go.dev/doc/install)\n\nThen, clone from soure code and install:\n\n```sh\ngit clone https://github.com/ductnn/cUrls.git\ncd cUrls\ngo get\n```\n\n## Usage\n\nRun command:\n\n```\ngo run curls.go \u003e sub.txt\n# Enter domain you want to crawl.\n# Example\nhttp://httpbin.org/\n```\n\nCheck results in file *sub.txt*:\n\n```txt\nVisiting http://httpbin.org/\nLink found: \"\\n        \\n            \\n            \\n            \\n        \\n    \" -\u003e https://github.com/requests/httpbin\nLink found: \"the developer - Website\" -\u003e https://kennethreitz.org\nLink found: \"Send email to the developer\" -\u003e mailto:me@kennethreitz.org\nLink found: \"Flasgger\" -\u003e https://github.com/rochacbruno/flasgger\nLink found: \"HTML form\" -\u003e /forms/post\n```\n\nSo done !!! =))))\n\n### Show your support\nGive a ⭐ if you like this application ❤️\n\n## Contribution\nContributions are more than welcome in this project!\n\n## License\nThe MIT License (MIT). Please see [LICENSE](license) for more information.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fductnn%2Fcurls","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fductnn%2Fcurls","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fductnn%2Fcurls/lists"}