https://github.com/coslynx/twitter-gemini-github-mvp
Scrapes Twitter data, commits to Gemini, Linux NodeJS powered. Initial release.... Created at https://coslynx.com
https://github.com/coslynx/twitter-gemini-github-mvp
automated-workflow code-generation coslynx data-processing developer-tools devops expressjs gemini-ai github-api github-integration javascript machine-learning markdown-generator mongodb mvp node-cron node-js-backend nodejs twitter-api twitter-scraper
Last synced: about 1 month ago
JSON representation
Scrapes Twitter data, commits to Gemini, Linux NodeJS powered. Initial release.... Created at https://coslynx.com
- Host: GitHub
- URL: https://github.com/coslynx/twitter-gemini-github-mvp
- Owner: coslynx
- Created: 2024-11-17T05:01:28.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-12-25T18:01:25.000Z (about 1 year ago)
- Last Synced: 2025-05-30T16:31:39.632Z (10 months ago)
- Topics: automated-workflow, code-generation, coslynx, data-processing, developer-tools, devops, expressjs, gemini-ai, github-api, github-integration, javascript, machine-learning, markdown-generator, mongodb, mvp, node-cron, node-js-backend, nodejs, twitter-api, twitter-scraper
- Language: JavaScript
- Size: 150 KB
- Stars: 0
- Watchers: 1
- Forks: 3
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
Twitter-Gemini-GitHub-MVP
Automates Twitter data collection and GitHub Markdown storage using Gemini AI
Developed with the software and tools below.
## 📑 Table of Contents
- 📍 Overview
- 📦 Features
- 📂 Structure
- 💻 Installation
- 🏗️ Usage
- 🌐 Hosting
- 📄 License
- 👏 Authors
## 📍 Overview
This repository contains a Minimum Viable Product (MVP) that automates the collection of Twitter data and stores it in a structured Markdown format on GitHub, leveraging Google's Gemini AI for content processing. This addresses the need for researchers and developers to efficiently collect and organize relevant Twitter content.
## 📦 Features
| | Feature | Description |
| --- | --------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------- |
| 1 | Twitter Authentication & Scraping | Authenticates with the Twitter API v2 and scrapes tweets based on specified keywords or hashtags. Handles rate limits and errors. |
| 2 | Gemini AI Content Generation | Uses Google's Gemini API to convert scraped tweet data into well-formatted Markdown files. |
| 3 | GitHub Repository Management | Interacts with a designated GitHub repository to commit the generated Markdown files to a specified folder. Handles rate limits and errors. |
| 4 | Automated Timely Execution | Automates the entire process using Node-cron to run at specified time. Includes error handling and discord webhook notifications. |
## 💻 Installation
### 🔧 Prerequisites
- Node.js v16+
- npm 8+
- MongoDB
- A Google Cloud Project with the Gemini API enabled
- A GitHub account and Personal Access Token
- Twitter account credentials
### 🚀 Setup Instructions
1. Clone and install:
```bash
git clone https://github.com/Drix10/Twitter-Gemini-GitHub-MVP.git
cd Twitter-Gemini-GitHub-MVP
npm install
```
2. Create a `.env` file with the following configuration:
```bash
GITHUB_PAT= # The GitHub personal access token
GEMINI_API_KEY= # The Gemini API key
MONGODB_URI= # The MongoDB URI
TWITTER_USERNAME= # Your Twitter username
TWITTER_PASSWORD= # Your Twitter password
DISCORD_WEBHOOK_URL= # Your Discord webhook URL
GITHUB_REPO=userName/repoName # The repository where the tweets will be saved
GITHUB_FOLDER_ONE= # The folder where the tweets will be saved
GITHUB_FOLDER_TWO= # The folder where the tweets will be saved
GITHUB_FOLDER_THREE= # The folder where the tweets will be saved
```
## 🏗️ Usage
### 🏃♂️ Running the MVP
1. Start the server:
```bash
npm run start
```
2. The application will run on port 3000 with hourly cron jobs by default.
## 📄 License & Attribution
### 📄 License
This Minimum Viable Product (MVP) is licensed under the [GNU AGPLv3](https://choosealicense.com/licenses/agpl-3.0/) license.
### 🤖 AI-Generated MVP
This MVP was entirely generated using artificial intelligence through [CosLynx.com](https://coslynx.com).
No human was directly involved in the coding process of the repository: Twitter-Gemini-GitHub-MVP
Note: A final version was finished and pushed via a human due to a special case.
### 📞 Contact
For any questions or concerns regarding this AI-generated MVP, please contact CosLynx at:
- Website: [CosLynx.com](https://coslynx.com)
- Twitter: [@CosLynxAI](https://x.com/CosLynxAI)
🌐 CosLynx.com
Create Your Custom MVP in Minutes With CosLynxAI!
