{"id":21662609,"url":"https://github.com/kamiyuzu/twitch_api_scraper","last_synced_at":"2026-05-17T22:37:04.546Z","repository":{"id":61305184,"uuid":"408983275","full_name":"kamiyuzu/twitch_api_scraper","owner":"kamiyuzu","description":"The project provides jsons with all the methods and models from Twitch API reference","archived":false,"fork":false,"pushed_at":"2023-02-02T22:01:50.000Z","size":1599,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2025-03-20T05:48:11.400Z","etag":null,"topics":["hacktoberfest"],"latest_commit_sha":null,"homepage":"","language":"Elixir","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/kamiyuzu.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2021-09-21T21:48:35.000Z","updated_at":"2022-10-12T15:06:59.000Z","dependencies_parsed_at":"2023-02-18T01:01:21.949Z","dependency_job_id":null,"html_url":"https://github.com/kamiyuzu/twitch_api_scraper","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/kamiyuzu/twitch_api_scraper","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kamiyuzu%2Ftwitch_api_scraper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kamiyuzu%2Ftwitch_api_scraper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kamiyuzu%2Ftwitch_api_scraper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kamiyuzu%2Ftwitch_api_scraper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/kamiyuzu","download_url":"https://codeload.github.com/kamiyuzu/twitch_api_scraper/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kamiyuzu%2Ftwitch_api_scraper/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":33157808,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-17T09:28:26.183Z","status":"ssl_error","status_checked_at":"2026-05-17T09:27:52.702Z","response_time":107,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["hacktoberfest"],"created_at":"2024-11-25T10:17:22.684Z","updated_at":"2026-05-17T22:37:04.530Z","avatar_url":"https://github.com/kamiyuzu.png","language":"Elixir","funding_links":[],"categories":[],"sub_categories":[],"readme":"[![CI](https://github.com/kamiyuzu/twitch_api_scraper/actions/workflows/elixir_cd.yml/badge.svg)](https://github.com/kamiyuzu/twitch_api_scraper/actions/workflows/elixir_cd.yml/badge.svg)\n[![CI](https://github.com/kamiyuzu/twitch_api_scraper/actions/workflows/elixir_ci.yml/badge.svg)](https://github.com/kamiyuzu/twitch_api_scraper/actions/workflows/elixir_ci.yml/badge.svg)\n![GitHub](https://img.shields.io/github/license/kamiyuzu/twitch_api_scraper)\n[![Coverage Status](https://coveralls.io/repos/github/kamiyuzu/twitch_api_scraper/badge.svg?branch=main)](https://coveralls.io/github/kamiyuzu/twitch_api_scraper?branch=main)\n[![Last Updated](https://img.shields.io/github/last-commit/kamiyuzu/twitch_api_scraper.svg)](https://github.com/kamiyuzu/twitch_api_scraper/commits/main)\n\n# TwitchApiScraper\n\nThis projects scrapes the website for the [Twitch API](https://dev.twitch.tv/docs/api/reference). The project provides a json with a more human readable interface. API library creators can get all the methods and models without having to write them all manually.\n\nAlso this helps the developers to update their libraries to the last Twitch API easily!\n\n## Local development environment\n\n- Install elixir/erlang using `asdf`\n\nInformation to install asdf can be found [here](https://github.com/asdf-vm/asdf)\n\n```bash\nasdf plugin-add erlang https://github.com/asdf-vm/asdf-erlang\nasdf plugin-add elixir https://github.com/asdf-vm/asdf-elixir\n```\n\n```bash\nasdf install\n```\n\nor install Erlang and Elixir on your machine.\n\n## API JSON\n\nIn this repository you can find two JSON files being exported:\n\n- Minimum JSON: [https://raw.githubusercontent.com/kamiyuzu/twitch_api_scraper/master/lib/fixtures/json/twitch_api.json](https://raw.githubusercontent.com/kamiyuzu/twitch_api_scraper/master/lib/fixtures/json/twitch_api.json)\n  This json is the least bytes possible, perfect to be consumed by the libraries.\n\n- Pretty JSON: [https://raw.githubusercontent.com/kamiyuzu/twitch_api_scraper/master/lib/fixtures/json/twitch_api_pretty.json](https://raw.githubusercontent.com/kamiyuzu/twitch_api_scraper/master/lib/fixtures/json/twitch_api_pretty.json)\n  This json is the same as the minimum json, but prettify, so a human can read it better 😄\n\nAlso, you can navigate in the json with some viewer, for example: [http://jsonviewer.stack.hu/](http://jsonviewer.stack.hu/)\n\n## Understand the JSON\n\nThe JSON have three root fields: `id`, `doc` and `request`, each of this are a list with the defined data, let's see what can have every one of this.\n\n### id\n\nThis field stores the id which the [Twitch API](https://dev.twitch.tv/docs/api/reference) references inside its HTML attributes.\n\n### doc\n\nThis field provides the information which the [Twitch API](https://dev.twitch.tv/docs/api/reference) gives as example for the [Twitch API](https://dev.twitch.tv/docs/api/reference) requests.\n\n### request\n\nThis last field stores all the required information from the [Twitch API](https://dev.twitch.tv/docs/api/reference) for making the actual request.\n\n## Development\n\nThis project is written in Elixir and uses Floki as HTML parser to extract the Twitch API information.\n\nAll contributions are welcome, if you make a PR and changes some bug or add a feature that changes the final JSON, remember to execute the script `./export.sh` to generate the new JSON files.\n\n## Authors\n\n* **Alberto Revuelta Arribas** - *initial work* [kamiyuzu](https://github.com/kamiyuzu)\n\n## License\n\n* This project is licensed under the License - see the [LICENSE.md](LICENSE.md) file for details.\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkamiyuzu%2Ftwitch_api_scraper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fkamiyuzu%2Ftwitch_api_scraper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkamiyuzu%2Ftwitch_api_scraper/lists"}