{"id":16462202,"url":"https://github.com/digitaldreams/image-crawler-python","last_synced_at":"2025-03-23T10:33:58.866Z","repository":{"id":41481034,"uuid":"111671748","full_name":"digitaldreams/image-crawler-python","owner":"digitaldreams","description":"Find image from a web url and save it to your project folder","archived":false,"fork":false,"pushed_at":"2017-11-25T15:16:11.000Z","size":62,"stargazers_count":38,"open_issues_count":2,"forks_count":13,"subscribers_count":2,"default_branch":"master","last_synced_at":"2024-10-11T11:11:09.566Z","etag":null,"topics":["image-crawler","python-library","python-script","python3"],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/digitaldreams.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2017-11-22T10:47:00.000Z","updated_at":"2024-06-09T19:26:22.000Z","dependencies_parsed_at":"2022-09-05T05:01:34.461Z","dependency_job_id":null,"html_url":"https://github.com/digitaldreams/image-crawler-python","commit_stats":null,"previous_names":[],"tags_count":7,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/digitaldreams%2Fimage-crawler-python","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/digitaldreams%2Fimage-crawler-python/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/digitaldreams%2Fimage-crawler-python/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/digitaldreams%2Fimage-crawler-python/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/digitaldreams","download_url":"https://codeload.github.com/digitaldreams/image-crawler-python/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":221849554,"owners_count":16891488,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["image-crawler","python-library","python-script","python3"],"created_at":"2024-10-11T11:10:41.177Z","updated_at":"2024-10-28T15:36:57.029Z","avatar_url":"https://github.com/digitaldreams.png","language":"Python","readme":"# Multi threading image crawler in python 3\nFind all the images from a website and download to your project folder. Purpose of this project is to learning coding in Python. Please do not use it to your production server yet.\n```python\nfrom Crawler.Page import Page\nfrom Crawler.Image import Image\nfrom Image.Download import Download\n\nif __name__ == '__main__':\n    page = Page('http://fdfashionltd.com');\n    # fetch all the links (anchor) of this website\n    links = page.fetch_links();\n\n    for link in links:\n        # fetch all of the images of a web url\n        img = Image(link);\n        images = img.fetch_links();\n        # Download all of the images \n        download = Download(links=links)\n        download.start()\n```\nThis code is to demonstrate the flow of the work. Please run main.py code because threading are used there. So program will be completed lot faster than this one.\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdigitaldreams%2Fimage-crawler-python","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdigitaldreams%2Fimage-crawler-python","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdigitaldreams%2Fimage-crawler-python/lists"}