{"id":15289139,"url":"https://github.com/pps-22-scooby/pps-22-scooby","last_synced_at":"2025-10-24T08:06:48.408Z","repository":{"id":243498758,"uuid":"809843173","full_name":"PPS-22-Scooby/PPS-22-Scooby","owner":"PPS-22-Scooby","description":"Scala application that allows web crawling and web scraping of web pages given as input with the use of special rules passed to it through the use of a DSL.","archived":false,"fork":false,"pushed_at":"2024-08-07T14:12:14.000Z","size":4508,"stargazers_count":7,"open_issues_count":0,"forks_count":1,"subscribers_count":3,"default_branch":"main","last_synced_at":"2025-02-21T17:11:13.325Z","etag":null,"topics":["crawler","crawlers","internal-dsl","scala","scraper","scrapers","web","web-crawler","web-crawling","web-scraper","web-scrapers"],"latest_commit_sha":null,"homepage":"https://pps-22-scooby.github.io/","language":"Scala","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/PPS-22-Scooby.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-06-03T14:53:41.000Z","updated_at":"2024-08-07T23:18:00.000Z","dependencies_parsed_at":"2024-10-14T20:00:35.216Z","dependency_job_id":"e299d222-ec91-4097-88f3-597c5572bc64","html_url":"https://github.com/PPS-22-Scooby/PPS-22-Scooby","commit_stats":null,"previous_names":["pps-22-scooby/pps-22-scooby"],"tags_count":6,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/PPS-22-Scooby%2FPPS-22-Scooby","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/PPS-22-Scooby%2FPPS-22-Scooby/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/PPS-22-Scooby%2FPPS-22-Scooby/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/PPS-22-Scooby%2FPPS-22-Scooby/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/PPS-22-Scooby","download_url":"https://codeload.github.com/PPS-22-Scooby/PPS-22-Scooby/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":240271523,"owners_count":19774859,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["crawler","crawlers","internal-dsl","scala","scraper","scrapers","web","web-crawler","web-crawling","web-scraper","web-scrapers"],"created_at":"2024-09-30T15:59:21.937Z","updated_at":"2025-10-24T08:06:48.320Z","avatar_url":"https://github.com/PPS-22-Scooby.png","language":"Scala","funding_links":[],"categories":[],"sub_categories":[],"readme":"# PPS-22-Scooby 🔍\n\n## Team:\n\n👨‍💻 Giovanni Antonioni - giovanni.antonioni2@studio.unibo.it\n\n👨‍💻 Valerio Di Zio - valerio.dizio@studio.unibo.it\n\n👨‍💻 Francesco Magnani - francesco.magnani14@studio.unibo.it\n\n👨‍💻 Luca Rubboli - luca.rubboli2@studio.unibo.it\n\n## Technologies:\n\n🔄 Scrum\n\n🛠 SBT\n\n🔗 Git\n\n🎯 YouTrack\n\n🚀 Github Actions\n\n## Overview:\n\nPPS-22-Scooby is a web scraping and crawling application. It enables users to extract data from web pages by crawling through links and scraping specific content according to predefined rules.\n\n## Features:\n\n🕷 **Crawling**: The application navigates web pages, follows links, and retrieves content.\n\n🔍 **Scraping**: Relevant data is extracted from HTML/XML pages using XPath, CSS selectors, or regular expressions.\n\n🛠 **Customization**: Users can define custom scraping and crawling rules to suit their specific needs.\n\n⚙️ **Parallel Processing**: Aspects of parallel programming are integrated for efficient execution.\n\n📤 **Export**: Users can export extracted data in various formats according to their preferences.\n\n## Implementation:\n\nPPS-22-Scooby is built using Scala with Actor libraries for concurrency management. The application utilizes Git for version control, YouTrack for project management, and Github Actions for continuous integration.\n\n## Get Started:\n\nTo use PPS-22-Scooby, have a look at the section **Get Started** at https://pps-22-scooby.github.io/\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpps-22-scooby%2Fpps-22-scooby","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fpps-22-scooby%2Fpps-22-scooby","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpps-22-scooby%2Fpps-22-scooby/lists"}