https://github.com/v3l0s-c0d3r/serp-analyzer
A SERP Python program that makes use of Google Search API to fetch results from the web via user queries.
https://github.com/v3l0s-c0d3r/serp-analyzer
api python serp
Last synced: about 2 months ago
JSON representation
A SERP Python program that makes use of Google Search API to fetch results from the web via user queries.
- Host: GitHub
- URL: https://github.com/v3l0s-c0d3r/serp-analyzer
- Owner: v3l0s-c0d3r
- Created: 2025-04-15T21:39:39.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2025-04-15T22:48:34.000Z (over 1 year ago)
- Last Synced: 2025-04-19T06:43:03.079Z (over 1 year ago)
- Topics: api, python, serp
- Language: Python
- Homepage:
- Size: 15.6 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# SERP Analysis Tool with Google Custom Search API
A Python-based Search Engine Results Page (SERP) analysis tool that leverages the Google Custom Search JSON API to fetch and analyze web content for specialized research domains. Developed as a course project in my third year.
## Core Technologies:
- Python (3.8 +)
- Google Custom Search JSON API
- Matplotlib (for visualisation)
- Concurrent execution via `ThreadPoolExecutor`
## Key Features
- **Multi-mode Search Capability**:
- General web search
- Crime reporting papers analysis
- Deep learning journal papers analysis
- **Structured Data Extraction**:
- Identifies 100+ crime-reporting features (incident details, victim info, evidence, etc.)
- Detects academic paper sub-headings in deep learning publications
- **Visual Analytics**:
- Automated bar chart generation for feature frequency analysis
- Threaded processing for concurrent data extraction/visualization
## Usage
1. **Configure API**:
- Replace placeholder credentials in `utils.py`:
```python
API_KEY = "your_google_api_key"
SEARCH_ENGINE_ID = "your_search_engine_id"
```
2. **Run the program**:
```bash
python main.py
```
3. **Select analysis mode:**
- General search
- Crime reporting analysis
- Deep learning paper analysis
## Usage Examples
**Crime-Reporting Mode:**
```bash
Copy
> Select mode: 2
> Query: "homicide investigation techniques 2023"
Analyzing 10 results...
- Extracted 23 incident_details features
- Found 8 weapon/evidence references
- Generated visualization: crime_features.png
```