Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/jroakes/seodp
The SEO Data Platform automates SEO analysis, aggregating data from Google Analytics 4, Search Console, Page Speed Insights, and rendered content. Powered by Google Gemini AI, it emails actionable insights weekly or monthly, streamlining SEO workflows.
https://github.com/jroakes/seodp
automation llm seo
Last synced: 19 days ago
JSON representation
The SEO Data Platform automates SEO analysis, aggregating data from Google Analytics 4, Search Console, Page Speed Insights, and rendered content. Powered by Google Gemini AI, it emails actionable insights weekly or monthly, streamlining SEO workflows.
- Host: GitHub
- URL: https://github.com/jroakes/seodp
- Owner: jroakes
- License: mit
- Created: 2024-10-01T15:02:23.000Z (3 months ago)
- Default Branch: main
- Last Pushed: 2024-10-20T19:21:21.000Z (3 months ago)
- Last Synced: 2024-12-21T17:56:03.747Z (20 days ago)
- Topics: automation, llm, seo
- Language: Python
- Homepage:
- Size: 2.85 MB
- Stars: 13
- Watchers: 2
- Forks: 1
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE.md
Awesome Lists containing this project
README
# SEO Data Platform
## Description
The SEO Data Platform is a comprehensive tool designed to automate the collection, analysis, and reporting of SEO-related data. It integrates with various data sources such as Google Analytics 4, Google Search Console, and PageSpeed Insights to provide actionable insights for improving website performance and search engine rankings.
## Features
- Automated data collection from multiple sources
- Integration with Google Analytics 4, Google Search Console, and PageSpeed Insights
- URL content extraction and analysis
- LLM-powered insights generation using Google's Gemini API
- Configurable reporting topics and significance thresholds
- Scheduled data processing and report generation
- Email reporting functionality
## Installation
1. Clone the repository:
```
git clone https://github.com/jroakes/SEODP.git
cd SEODP
```
2. Install the required dependencies:
`pip install -r requirements.txt`
You can also use poetry.
3. Set up the configuration file:
- Edit `seodpconfig.yaml` with your specific settings
4. Set up environment variables:
- Create a `.env` file in the project root
- Add the required API keys and credentials (see Configuration section)
## Usage
To start the SEO Data Platform:
`python src/seodp/main.py --start`
For other command-line options:
`python src/seodp/main.py --help`
## Configuration
### Environment Variables
Set the following environment variables in your `.env` file:
- `SERVICE_ACCOUNT_FILE_PATH`: Path to your Google service account JSON file
- `SUBJECT_EMAIL`: Email address for Google API authentication
- `SCRAPINGBEE_API_KEY`: Your ScrapingBee API key
- `GEMINI_API_KEY`: Your Google Gemini API key
- `MAILTRAP_LOGIN`: Your Mailtrap login
- `MAILTRAP_PASSWORD`: Your Mailtrap password
- `MAILTRAP_SENDER_EMAIL`: Sender email for Mailtrap
- `RECIPIENT_EMAIL`: Recipient email for reports
See `.env.example` example file.
### Configuration File
Edit `seodpconfig.yaml` to customize:
- URLs to analyze
- Reporting schedule
- Data sources and API settings
- Reporting topics and thresholds
## Project Structure
- `src/seodp/`: Main source code directory
- `main.py`: Entry point of the application
- `settings.py`: Configuration loading and management
- `lib/`: Core functionality modules
- `extractors/`: Data extraction modules for different sources
- `manager/`: Data processing and management modules
- `api/`: API client modules (e.g., Gemini, email)
## Contributing
Contributions to the SEO Data Platform are welcome! Please follow these steps:
1. Fork the repository
2. Create a new branch for your feature
3. Commit your changes
4. Push to your fork
5. Submit a pull request
Please ensure your code adheres to the project's coding standards and include tests for new functionality.
### Ideas for Contributing
- [ ] Don't re-hit PSI when backfilling data on initial run
- [ ] Async!!!!!!!!!!!!!!!!!!!!!!!!!!! processing
- [x] ~~Use something called Pydantic (Hey Joe!)~~
- [ ] Add YoY as well PoP for comparison
- [ ] Fine tune some models
- [ ] Add a SEMRush, Ahrefs, or Nozzle extractor???!!!
- [ ] Build a one-click deployer on Digital Ocean or something
## License
MIT