{"id":7689830,"url":"https://github.com/AmirAref/DivarCrawler","last_synced_at":"2025-07-13T12:31:40.908Z","repository":{"id":40700648,"uuid":"409568445","full_name":"AmirAref/DivarCrawler","owner":"AmirAref","description":"an script to crawl divar.ir and extract phone numbers","archived":false,"fork":false,"pushed_at":"2024-06-18T10:32:18.000Z","size":6670,"stargazers_count":5,"open_issues_count":1,"forks_count":1,"subscribers_count":1,"default_branch":"main","last_synced_at":"2024-11-22T10:36:14.861Z","etag":null,"topics":["crawler","scraper","selenium"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/AmirAref.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-09-23T11:45:56.000Z","updated_at":"2024-06-18T10:32:15.000Z","dependencies_parsed_at":"2024-11-22T10:40:55.126Z","dependency_job_id":null,"html_url":"https://github.com/AmirAref/DivarCrawler","commit_stats":null,"previous_names":["amiraref/divarcrawler"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/AmirAref/DivarCrawler","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AmirAref%2FDivarCrawler","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AmirAref%2FDivarCrawler/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AmirAref%2FDivarCrawler/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AmirAref%2FDivarCrawler/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/AmirAref","download_url":"https://codeload.github.com/AmirAref/DivarCrawler/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AmirAref%2FDivarCrawler/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":265139267,"owners_count":23717280,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["crawler","scraper","selenium"],"created_at":"2024-04-09T13:02:08.540Z","updated_at":"2025-07-13T12:31:39.324Z","avatar_url":"https://github.com/AmirAref.png","language":"Python","funding_links":[],"categories":["Python"],"sub_categories":[],"readme":"\u003ch1 dir=\"rtl\"\u003eCrawler دیوار\u003c/h1\u003e\n\nاین یک اسکریپت برای crawl کردن سایت [divar.ir](https://divar.ir) است، می تواند آگهی ها را بر اساس شهر یا دسته بندی  با اعمال محدودیت تعداد جمع آوری کند و می تواند لینک های آگهی ها و تلفن صاحبان آگهی ها را استخراج کند.\nاسکریپت با کتابخانه‌ی selenium کار می کند که نیاز به web driver یک مرورگر دارد، من از مرورگر edge استفاده کردم اما می توانید با کمی ویرایش آن را با مرورگر خود تغییر دهید.\nاسکریپت برای اینکه بتواند شماره تلفن ها را استخراج کند ، به یک شماره ایران نیاز دارد \n\n\n\n## راه اندازی برنامه\n\n\u003ch3 dir=\"rtl\"\u003econfig برنامه :\u003c/h3\u003e\n\nدر فایل «config.py» متغیرها را برای cralwer شخصی سازی کنید\n\n### نصب requirements:\n\n```bash\npip install -r requirements.txt\n```\n\n### اجرای برنامه :\n\n```bash\npython bot.py\n```\n\n### اطلاعات مرورگر :\n\nMicrosoft edge (Version 93.0.961.52 (Official build) (64-bit) )\n\n\n\u003cbr\u003e\n\u003chr\u003e\n\u003cbr\u003e\n\n\n# Divar.ir Crawler\n\nThis is a script to crawl on the site [divar.ir](https://divar.ir), can collect ads by city or category with restrictions on the number and can be ads and phone links Extract banner owners.\nThe script works with selenium which requires a browser web driver, I used the edge browser but you can modify it with your browser with a little editing.\nThe script needs an Iranian number to be able to extract phone numbers\n\n\n\n## Start the app\n\n### Config the app :\n\nin `config.py` make customize the variables to crawler\n\n### Install requirements :\n\n```bash\npip install -r requirements.txt\n```\n\n### Run the app :\n\n```bash\npython bot.py\n```\n\n### Browser Info :\n\nMicrosoft edge (Version 93.0.961.52 (Official build) (64-bit) )\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FAmirAref%2FDivarCrawler","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FAmirAref%2FDivarCrawler","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FAmirAref%2FDivarCrawler/lists"}