{"id":13892820,"url":"https://github.com/nvalis/MappingYoutube","last_synced_at":"2025-07-17T06:31:11.326Z","repository":{"id":91016888,"uuid":"81219874","full_name":"nvalis/MappingYoutube","owner":"nvalis","description":"Generate a visual map of youtube by using channel relations.","archived":false,"fork":false,"pushed_at":"2019-02-11T20:06:05.000Z","size":13811,"stargazers_count":4,"open_issues_count":1,"forks_count":1,"subscribers_count":1,"default_branch":"master","last_synced_at":"2024-08-07T17:30:57.841Z","etag":null,"topics":["gephi","graph","scraping","youtube"],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/nvalis.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null}},"created_at":"2017-02-07T14:57:40.000Z","updated_at":"2021-11-22T18:24:28.000Z","dependencies_parsed_at":"2024-01-19T08:12:47.265Z","dependency_job_id":"d1d5a053-50f8-4a80-9253-5fb7e8516564","html_url":"https://github.com/nvalis/MappingYoutube","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nvalis%2FMappingYoutube","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nvalis%2FMappingYoutube/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nvalis%2FMappingYoutube/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nvalis%2FMappingYoutube/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/nvalis","download_url":"https://codeload.github.com/nvalis/MappingYoutube/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":226226190,"owners_count":17592345,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["gephi","graph","scraping","youtube"],"created_at":"2024-08-06T17:01:15.035Z","updated_at":"2024-11-24T20:31:22.263Z","avatar_url":"https://github.com/nvalis.png","language":"Python","readme":"# MappingYoutube\n\nThis python script generates a graph of [Youtube](https://www.youtube.com) by scraping the related channels from the \"about\" page using `requests` and `lxml` because unfortunately this data is not provided by the Youtube API.\nThe gathered data is streamed to [Gephi](https://github.com/gephi/gephi) for visualization using the [gephistreamer](https://github.com/totetmatt/GephiStreamer) library.\n\nThe scraping is coordinated by a size limited, thread-safe python `set` as the queue to keep track of the channels to explore. It makes use of multithreading and a simple history to accelerate the exploration.\n\n![Screenshot](/MappingYoutube.png \"Screenshot\")\n\nExample map created in about 14 min of scraping consisting of about 10000 channels. With the ForceAtlas 2 layout in LinLog mode one can observe different youtube communities mostly grouped around one or more central hubs (node color shows its in-degree, red is higher).\n\n## Requirements\n\nFor data streaming to Gephi you need the [`Graph Streaming`](https://marketplace.gephi.org/plugin/graph-streaming/) plugin available in Gephis plugin manager. When installed you will need to rightclick -\u003e start the streaming master server.","funding_links":[],"categories":["Python"],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnvalis%2FMappingYoutube","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fnvalis%2FMappingYoutube","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnvalis%2FMappingYoutube/lists"}