{"id":13568773,"url":"https://github.com/hjunker/TwitterSearch2Gephi","last_synced_at":"2025-04-04T05:30:32.354Z","repository":{"id":174619121,"uuid":"276101975","full_name":"hjunker/TwitterSearch2Gephi","owner":"hjunker","description":"This windows CLI app lets you collect data from twitter via REST API and convert it into a CSV data set that can be used with Gephi. Other social networks (Reddit, Youtube, WWW) are also supported.","archived":false,"fork":false,"pushed_at":"2020-10-26T14:14:17.000Z","size":3534,"stargazers_count":25,"open_issues_count":0,"forks_count":2,"subscribers_count":3,"default_branch":"master","last_synced_at":"2024-11-05T01:34:28.092Z","etag":null,"topics":["analysis","api","disinfo","disinformation","gephi","reddit","search","twitter","www","youtube"],"latest_commit_sha":null,"homepage":"https://twitter.com/DisinfoG","language":"C#","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/hjunker.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2020-06-30T13:09:43.000Z","updated_at":"2024-02-02T00:58:06.000Z","dependencies_parsed_at":null,"dependency_job_id":"c13c0b38-bad2-4e8d-8bac-991810fc9410","html_url":"https://github.com/hjunker/TwitterSearch2Gephi","commit_stats":null,"previous_names":["hjunker/twittersearch2gephi"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hjunker%2FTwitterSearch2Gephi","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hjunker%2FTwitterSearch2Gephi/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hjunker%2FTwitterSearch2Gephi/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hjunker%2FTwitterSearch2Gephi/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/hjunker","download_url":"https://codeload.github.com/hjunker/TwitterSearch2Gephi/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247128696,"owners_count":20888232,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["analysis","api","disinfo","disinformation","gephi","reddit","search","twitter","www","youtube"],"created_at":"2024-08-01T14:00:31.618Z","updated_at":"2025-04-04T05:30:32.056Z","avatar_url":"https://github.com/hjunker.png","language":"C#","funding_links":["https://www.paypal.com/cgi-bin/webscr?cmd=_s-xclick\u0026hosted_button_id=WLC2SHZL6SPNY"],"categories":["C# #"],"sub_categories":[],"readme":"# TwitterSearch2Gephi\nTwitterSearch2Gephi is a windows CLI app that lets you collect data from social media and convert it into a CSV data set that can be used with Gephi. Currently it supports\n* Twitter\n* Reddit\n* Youtube\n* WWW domains / URLs\n\nMore social media platforms and more features for the platforms already implemented will be added later.\n\nWritten by [@DisinfoG](https://twitter.com/DisinfoG)\n\n## Installation\nCurrently there is no binary package available for TwitterSearch2Gephi on GitHub. As Obi Wan would say: May the source be with you. Currently TwitterSearch2Gephi does not intend to be a product (and it probably won't in the near future) - it is more like a PoC or something to get you started. Depending on what you want to do with it, you have to code yourself or contact me. Basic knowledge in coding (not necessarily .NET) and should be sufficient.\n\nTwitterSearch2Gephi requires the folder C:\\TwitterSearch2Gephi as its working directory where it can read and write files. In case you want to use TwitterSearch2Gephi with Mono, you have to adjust this (hard coded) directory. This should be enough to get you up and running with Mono since TwitterSearch2Gephi is a .NET-Core application (not a full .NET application).\n\n![x](img/githubimg01.png)\n\nThe credentials for accessing the twitter REST API have to be placed in credentials.txt with one entry in each line for consumerKey, consumerSecret, userAccessToken, userAccessSecret in this order.\n\nThe credentials for accessing the Reddit API have to be placed in redditcredentials.txt. The file needs to contain the 3 credential parameters for your reddit account / app one per line in the order appId, refreshToken, accessToken. These tokens have to be generated with a third party component such as Reddit.NET. If you get an 401 error you need to renew your credentials - these tokens become obsolete within a narrow time window of non-usage.\n\nThe credential (API-Key! *not* OAuth2.0) for accessing the Youtube API have to be placed in youtube.txt. Refer to https://console.developers.google.com/apis/dashboard in order to get an API key.\n\n## Usage\n![x](img/githubimg00.png)\n### Twitter (options a and s)\nTwitterSearch2Gephi takes the accounts (ScreenName) to look for from accounts.txt (one ScreenName per line without @). For each account it collects the following for generating engagements data. Alternatively you can collect data using the search terms in searchterms.txt.\n*\tFollowers (default max. 250)\n*\tFriends (default max. 250)\n*\tFavorites (default max. 40)\n*\tRetweets\n\nPlease note that ‘engagements’ refers to accounts engaging with another account or their tweets. The data is collected from twitter’s standard REST API, _not_ the engagements API.\n\nData collection can be performed recursive. Therefore TwitterSearch2Gephi will ask you for an integer to chose a maxdepth other than the default which is set to 1 for one iteration. It will also ask you whether to write the findings to file or send it live to gephi's web interface.\n\nThe tool is invoked by double-clicking TwitterSearch2Gephi.exe or starting it from a cmd shell. The output is written to edges.csv which can be imported to Gephi.\n![x](img/githubimg02.png)\n\n![x](img/githubimg03.png)\nGephi should automatically recognize the data in edges.csv as an edges table.\n![x](img/githubimg04.png)\nThe default import setting can be used.\n![x](img/githubimg05.png)\nTwitterSearch2Gephi creates edges.csv which typically contains parallel edges. Use the option 'w' to convert edges.csv to weighted-edges.csv.\n![x](img/githubimg06.png)\nIf everything works right you should see the data in the data lab view.\n![x](img/githubimg07.png)\nYou can now visualize the data using the layouts you have installed in Gephi.\n![x](img/githubimg08.png)\n\n### Reddit (option r)\ndocumentation coming soon\n\n### Youtube (option y)\ndocumentation coming soon\n\n### WWW (option d)\ndocumentation coming soon\n\n### general (options w, u and c)\ndocumentation coming soon\n\nOption 'u' converts edges.csv to edges-ucinet.csv in order to make it usable in UCINET. edges-ucinet.csv has to be converted to a xslx file (e.g. with LibreOffice). The xslx file can then be imported with UCINET's DL editor (type edges23). You can then save the imported data as ##d and ##h files. Work on these files with UCINET.\n\n## TODOs\nSome things are not implemented yet.\n* fix some issues on rate limits (currently TwitterSearch2Gephi does not always get that it is above rate limits and therefore does not process any engagements aka is skipping accounts)\n*\tCorrect implementation of the timeset parameter\n*\tHandling of special characters, emojis, etc.\n* documentation\n*\t…\n\n## Contact\nFeel free to give feedback or make feature requests here on GitHub or twitter (@DisinfoG / https://twitter.com/DisinfoG).\n\nFor services please refer to seculancer.de or DM @DisinfoG via Twitter.\n\n## Contribute to TwitterSearch2Gephi\nPlease feel free to give a spare dime/dollar/euro/... or two... It will be used to further enhance my open source projects.\n[![Donate](https://img.shields.io/badge/Donate-PayPal-green.svg)](https://www.paypal.com/cgi-bin/webscr?cmd=_s-xclick\u0026hosted_button_id=WLC2SHZL6SPNY)\n\nYou can also support my projects by donating hardware and other stuff to keep operative backend and development systems running. Please take a look at (my list on, [amazon](https://www.amazon.de/hz/wishlist/ls/2FD1Z75K43I7M?ref_=wl_share))\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhjunker%2FTwitterSearch2Gephi","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fhjunker%2FTwitterSearch2Gephi","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhjunker%2FTwitterSearch2Gephi/lists"}