{"id":18318727,"url":"https://github.com/xdevplatform/twitter-streaming-framework","last_synced_at":"2025-04-05T21:33:08.442Z","repository":{"id":40251224,"uuid":"434715219","full_name":"xdevplatform/twitter-streaming-framework","owner":"xdevplatform","description":"TypeScript/Node.js framework for processing Twitter data stream.","archived":false,"fork":false,"pushed_at":"2022-05-24T03:28:59.000Z","size":152,"stargazers_count":19,"open_issues_count":0,"forks_count":4,"subscribers_count":15,"default_branch":"main","last_synced_at":"2025-03-21T12:21:31.558Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/xdevplatform.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2021-12-03T19:46:02.000Z","updated_at":"2025-03-10T18:26:43.000Z","dependencies_parsed_at":"2022-09-12T17:53:31.319Z","dependency_job_id":null,"html_url":"https://github.com/xdevplatform/twitter-streaming-framework","commit_stats":null,"previous_names":["xdevplatform/twitter-streaming-framework"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/xdevplatform%2Ftwitter-streaming-framework","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/xdevplatform%2Ftwitter-streaming-framework/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/xdevplatform%2Ftwitter-streaming-framework/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/xdevplatform%2Ftwitter-streaming-framework/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/xdevplatform","download_url":"https://codeload.github.com/xdevplatform/twitter-streaming-framework/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247406076,"owners_count":20933803,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-05T18:11:23.821Z","updated_at":"2025-04-05T21:33:08.062Z","avatar_url":"https://github.com/xdevplatform.png","language":"TypeScript","readme":"# TWItter STreaming (TWIST) Framework\n\nThe TWItter STreaming (TWIST) framework contains [Node.js](https://nodejs.org/) utilities written in\n[TypeScript](https://www.typescriptlang.org/) for implementing Extract, Transform and Load (ETL)\npipelines. The framework handles streaming of Tweets from Twitter's\n[PowerTrack API](https://developer.twitter.com/en/docs/twitter-api/enterprise/powertrack-api/overview),\nand provides tools for sending high volumes of data to HTTP APIs for transformation and loading the\nresults into a database.\n\nThe framework also includes basic tools for building APIs on top of the data loaded into the\ndatabase.\n\n## What's in the box?\n\nThe `src/` directory contains the following folders:\n\n* **`database/`** base classes for accessing databases and tables.\n* **`http/`** classes for streaming HTTP data, managing highly parallel requests and serving APIs.\n* **`twitter/`** classes for streaming and searching Tweets through the Twitter API.\n* **`util/`** useful helpers.\n\nSome of these folders (e.g. `http` and `twitter`) include an `examples` subfolder with specific examples\nfor each package. In addition , the `src/app` direcotry includes a number of sample applications:\n\n* [**crypto/**](src/app/crypto/README.md) a dashboard showing public conversation trends around various crypto coins.\n* [**twidl/**](src/app/twidl/README.md) a downloader tool for large batches of historic Tweets.\n* [**vsa/**](src/app/vsa/README.md) a Visual Search API (VSA) for searching Tweets with logos or textual\nbrand mentions.\n\n## Contact us\n\n### Issues?\n\nPlease open tickets and pull requests on Github.\n\n### Security Issues?\n\nPlease report sensitive security issues via Twitter's bug-bounty program (https://hackerone.com/twitter)\nrather than GitHub.\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fxdevplatform%2Ftwitter-streaming-framework","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fxdevplatform%2Ftwitter-streaming-framework","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fxdevplatform%2Ftwitter-streaming-framework/lists"}