{"id":15673005,"url":"https://github.com/dnouri/twitter-discovery","last_synced_at":"2025-05-06T22:13:11.057Z","repository":{"id":141270606,"uuid":"269071884","full_name":"dnouri/twitter-discovery","owner":"dnouri","description":"Twitter Discovery: Search articles referenced in your tweets, retweets, and favorites","archived":false,"fork":false,"pushed_at":"2020-06-16T09:00:23.000Z","size":21,"stargazers_count":16,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-05-06T22:13:03.870Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/dnouri.png","metadata":{"files":{"readme":"README.rst","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-06-03T11:38:03.000Z","updated_at":"2025-04-16T13:58:58.000Z","dependencies_parsed_at":null,"dependency_job_id":"7f9ff11a-9eb6-48c8-a7c2-854304a51d96","html_url":"https://github.com/dnouri/twitter-discovery","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dnouri%2Ftwitter-discovery","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dnouri%2Ftwitter-discovery/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dnouri%2Ftwitter-discovery/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dnouri%2Ftwitter-discovery/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/dnouri","download_url":"https://codeload.github.com/dnouri/twitter-discovery/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":252776600,"owners_count":21802469,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-03T15:35:08.437Z","updated_at":"2025-05-06T22:13:10.671Z","avatar_url":"https://github.com/dnouri.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"Twitter Discovery\n=================\n\nTwitter Discovery lets you search articles referenced from your\ntweets, retweets, and favorites.\n\nInstallation\n------------\n\nInstall Twitter Discovery from source using ``pip install -e .``.\n(And do yourself a favor and `use venv\n\u003chttps://docs.python.org/3/tutorial/venv.html\u003e`_.)\n\nAlso install `twitter-to-sqlite\n\u003chttps://pypi.org/project/twitter-to-sqlite/\u003e`_ using ``pip install\ntwitter-to-sqlite``.  This is the tool that you'll use to download\ndata from Twitter.  Follow the instructions in the twitter-to-sqlite\ndocs and set up authentication with Twitter.\n\nUsage\n-----\n\nNote that *dnouri* is my own Twitter handle, so whenever you encounter\nthat in the commands below, you should replace *dnouri* with your own\nTwitter handle.\n\nHere's how you first download data from Twitter:\n\n- Retrieve your tweets and retweets using ``twitter-to-sqlite\n  user-timeline dnouri.db``.\n\n- Add favorites using ``twitter-to-sqlite favorites dnouri.db``.\n\nNow you're ready to find in the tweets that you downloaded any links\nto news articles and blogs.  The following command will find all such\nURLs and it will attempt to download the linked documents and save\nthem for further use: ``twitter-discovery articles dnouri.db dnouri``.\n\nFinally, use the web-based GUI to search all those articles.  To start\nit up, run: ``streamlit run twidis/main.py gui\narticles-dnouri.csv.gz``.\n\nThe GUI allows you to search articles by text, order them by date or\nwebsite, and so on.  The text search is case insensitive and supports\nthe use of quotation marks to group words, such that a search for\n``\"big finance\"`` will return articles that contain the phrase *big\nfinance*, while searching for ``big finance`` without the quotes will\nreturn articles that contain both the word *big* and the word\n*finance*.  The text search will match text inside the article's body,\nbut also in the article's title and the text of the tweet that\nreferenced the article.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdnouri%2Ftwitter-discovery","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdnouri%2Ftwitter-discovery","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdnouri%2Ftwitter-discovery/lists"}