{"id":23428477,"url":"https://github.com/giauphan/crawler-blog","last_synced_at":"2025-04-09T13:19:14.157Z","repository":{"id":183391214,"uuid":"668735135","full_name":"giauphan/Crawler-Blog","owner":"giauphan","description":null,"archived":false,"fork":false,"pushed_at":"2024-01-16T08:31:54.000Z","size":768,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-02-15T07:25:02.938Z","etag":null,"topics":["crawler","crawler-php","laravel"],"latest_commit_sha":null,"homepage":"","language":"PHP","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/giauphan.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2023-07-20T13:27:01.000Z","updated_at":"2024-02-29T08:37:18.000Z","dependencies_parsed_at":"2023-07-24T09:35:06.016Z","dependency_job_id":"f4865f00-c5b5-47f6-91e0-1b1f786a4a67","html_url":"https://github.com/giauphan/Crawler-Blog","commit_stats":null,"previous_names":["giauphan/crawler-blog"],"tags_count":2,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/giauphan%2FCrawler-Blog","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/giauphan%2FCrawler-Blog/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/giauphan%2FCrawler-Blog/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/giauphan%2FCrawler-Blog/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/giauphan","download_url":"https://codeload.github.com/giauphan/Crawler-Blog/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248045270,"owners_count":21038557,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["crawler","crawler-php","laravel"],"created_at":"2024-12-23T07:12:48.016Z","updated_at":"2025-04-09T13:19:14.129Z","avatar_url":"https://github.com/giauphan.png","language":"PHP","funding_links":[],"categories":[],"sub_categories":[],"readme":"#README - Crawler Blog for Laravel\nOverview\nWelcome to the Crawler Blog for Laravel repository! This powerful web scraping tool is designed to gather data from blogs and websites with ease, providing you with valuable insights and information. Whether you're a content creator, a market researcher, or an e-commerce entrepreneur, this Laravel-based crawler is the perfect solution for your data extraction needs.\n\nFeatures\nWeb Scraping: Utilize the crawler to extract data from various blogs and websites, including blog posts, product descriptions, prices, and customer reviews.\n\nUser-Friendly Interface: The crawler comes with a simple and intuitive interface, making it easy for both experts and beginners to use effectively.\n\nCustomizable Search Parameters: Tailor your search criteria to match your specific requirements. Filter results by date, location, product category, and more.\n\nAutomated Updates: Stay up-to-date with automated scheduling and regular data updates.\n\nData Visualization and Export: Analyze and comprehend extracted data with built-in visualization tools. Export data in formats like CSV, Excel, or JSON for further analysis or integration.\n\nPrivacy and Security: The crawler operates ethically and respects website terms of service to ensure privacy and security for users.\n\nInstallation\nFollow these steps to get the Crawler Blog for Laravel up and running:\n\nClone the repository:\n\n\nUsage\nSetting Up Crawler Parameters: Modify the crawler settings in the \n``\napp\\Console\\Commands\\CrawlBlogData.php \n``\nfile to adjust the scraping behavior based on your requirements.\n\nExecuting the Crawler: Run the crawler via the command line using the following command:\n\narduino\n```\nphp artisan app:crawl\n```\n\nThis will initiate the web scraping process, and the extracted data will be saved to the configured database tables.\n\nContributions\nWe welcome contributions from the community! If you find any bugs, have feature requests, or want to improve the crawler, please feel free to submit issues or pull requests on GitHub.\n\nLicense\nThe Crawler Blog for Laravel is open-source software licensed under the MIT License. Feel free to use, modify, and distribute it in accordance with the license terms.\n\nContact\nFor any further inquiries or support, please contact us at Giauphan012@gmail.com.\n\nThank you for using the Crawler Blog for Laravel! Happy scraping!\n\n\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgiauphan%2Fcrawler-blog","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fgiauphan%2Fcrawler-blog","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgiauphan%2Fcrawler-blog/lists"}