{"id":18460169,"url":"https://github.com/cldfire/overgg-scraper","last_synced_at":"2025-08-12T22:34:51.570Z","repository":{"id":85058466,"uuid":"101362948","full_name":"Cldfire/overgg-scraper","owner":"Cldfire","description":"A small Rust library to scrape useful data from over.gg","archived":false,"fork":false,"pushed_at":"2019-10-04T22:07:26.000Z","size":36,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-04-23T19:07:16.295Z","etag":null,"topics":["esports","overgg","overwatch","scraper"],"latest_commit_sha":null,"homepage":"","language":"Rust","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Cldfire.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE-APACHE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-08-25T03:39:59.000Z","updated_at":"2020-03-25T13:32:26.000Z","dependencies_parsed_at":"2023-03-13T04:14:32.747Z","dependency_job_id":null,"html_url":"https://github.com/Cldfire/overgg-scraper","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Cldfire%2Fovergg-scraper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Cldfire%2Fovergg-scraper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Cldfire%2Fovergg-scraper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Cldfire%2Fovergg-scraper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Cldfire","download_url":"https://codeload.github.com/Cldfire/overgg-scraper/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":250496990,"owners_count":21440231,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["esports","overgg","overwatch","scraper"],"created_at":"2024-11-06T08:25:49.527Z","updated_at":"2025-04-23T19:07:25.059Z","avatar_url":"https://github.com/Cldfire.png","language":"Rust","funding_links":[],"categories":[],"sub_categories":[],"readme":"# overgg-scraper\n\nA small Rust library to scrape useful data from [over.gg](https://www.over.gg/), a site that hosts articles, discussion, team information, match results, and upcoming / live match information for the competitive Overwatch scene.\n\n```rust\nlet dlr = Downloader::new()?;\nlet scraper = dlr.main_page()?;\n\nlet completed_matches = scraper.matches_brief(Completed);\nlet upcoming_matches = scraper.matches_brief(InFuture);\nlet live_matches = scraper.matches_brief(Live);\n```\n\nThe site unfortunately does not provide any kind of API to access its extremely useful data, which is why this scraper has to exist.\n\n## Development Status\n\nThis library currently only supports scraping a small amount of data from the site. I may or may not add support for collecting more data as time and interest allow. Contributions are certainly welcome!\n\nI do not currently intend to publish this on crates.io as it is a very niche crate.\n\n## Rust Version Support\n\nI only support the latest stable version of Rust; the library may or may not compile on an older version.\n\n## Cargo Features\n\n* `http_client` toggles compilation of the `http_client` module.\n* `derive-serde` toggles derivation of `serde`'s `Serialize` and `Deserialize` traits for appropriate data structures, both in this crate and its dependencies.\n* `test-local-data` is for the development of the library, enabling tests that utilize local HTML files.\n\nThe `http_client` feature is enabled by default.\n\n## Disclaimer\n\n**Please use this library responsibly**. It is intended for occasional programmatic retrieval of data from the [over.gg](https://www.over.gg/) site, nothing more, and I do not endorse excessive scraping.\n\n## License\n\nLicensed under either of\n\n* Apache License, Version 2.0\n   ([LICENSE-APACHE](LICENSE-APACHE) or http://www.apache.org/licenses/LICENSE-2.0)\n* MIT license\n   ([LICENSE-MIT](LICENSE-MIT) or http://opensource.org/licenses/MIT)\n\nat your option.\n\n### Contribution\n\nUnless you explicitly state otherwise, any contribution intentionally submitted\nfor inclusion in the work by you, as defined in the Apache-2.0 license, shall be\ndual licensed as above, without any additional terms or conditions.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcldfire%2Fovergg-scraper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcldfire%2Fovergg-scraper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcldfire%2Fovergg-scraper/lists"}