https://github.com/erzinrost/yandex-wordstat
Application which automates keywords download on Yandex Wordstat with Streamlit interface
https://github.com/erzinrost/yandex-wordstat
automation parsing selenium streamlit wordstat yandex
Last synced: about 2 months ago
JSON representation
Application which automates keywords download on Yandex Wordstat with Streamlit interface
- Host: GitHub
- URL: https://github.com/erzinrost/yandex-wordstat
- Owner: Erzinrost
- Created: 2025-02-05T21:01:29.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2025-02-18T18:46:17.000Z (over 1 year ago)
- Last Synced: 2025-04-05T22:29:31.234Z (about 1 year ago)
- Topics: automation, parsing, selenium, streamlit, wordstat, yandex
- Language: Python
- Homepage:
- Size: 140 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
**Yandex Wordstat Automated Keyword Data Downloader**
=====================================================
***Functional as of February 2025***
This project is a **Streamlit-based web application** that automates the process of downloading keyword data from [**Yandex Wordstat**](https://wordstat.yandex.ru/), a popular keyword research tool.
The application allows users to:\
✅ Upload an **Excel file** containing keywords\
✅ Enter their **Yandex login credentials**\
✅ **Automatically fetch** keyword statistics for specific regions (**Moscow & Saint Petersburg**)\
✅ **Download the results** as a CSV file
This tool is particularly useful for **marketers, SEO specialists, and researchers**, simplifying the process of retrieving **keyword trends and search volume data** from Yandex Wordstat.
### 📌 **Why Use This Tool?**
Yandex Wordstat provides **search volume data** based on user queries, helping businesses assess **market demand, customer interest, and marketing trends**. However, analyzing **a single keyword is not enough**---gathering insights across multiple keywords is crucial.
Since manually retrieving large keyword datasets is **time-consuming**, this project was developed to **automate and streamline** the process, especially when handling **large keyword lists**.
* * * * *
🚀 **Features**
---------------
🔹 **Excel File Upload** -- Upload an Excel file with keywords categorized into specific sheets (`MSK` for Moscow and `SPB` for Saint Petersburg).\
🔹 **Automated Keyword Retrieval** -- Uses **Selenium** to log into Yandex Wordstat, select regions, and fetch keyword statistics.\
🔹 **Dynamic Region Selection** -- Supports Moscow & Saint Petersburg, including their **respective surrounding regions**.\
🔹 **Real-Time Logging** -- Displays the **last 10 log messages** in a scrollable interface for **live status updates**.\
🔹 **Downloadable Results** -- Saves the fetched keyword data as a **CSV file** for easy access.\
🔹 **Local & Cloud Deployment** -- Designed to work **locally** or on **Streamlit Cloud**, but due to Yandex's security measures, local use is recommended.
* * * * *
🛠 **How It Works**
-------------------
### **1️⃣ Upload an Excel File**
- The Excel file must contain **two sheets**:
- **MSK** → Keywords for **Moscow & its region**
- **SPB** → Keywords for **Saint Petersburg & its region**
- Each sheet should have **keywords listed in the first column** (no headers required).
### **2️⃣ Enter Yandex Login Credentials**
- Provide your **Yandex username & password** to access Wordstat.
- If additional login verification (e.g., CAPTCHA, push codes) is required, you can **manually enter** them in the automated **Chrome window** controlled by Selenium.
### **3️⃣ Choose Deployment Environment**
- Select whether the app is running **locally** or on **Streamlit Cloud**.
- If using **Streamlit Cloud**, be aware of potential issues:
- Yandex may require **manual verification** (CAPTCHA, push codes).
- No manual control over **unexpected UI changes**.
### **4️⃣ Run the Processing**
- The script will **log into Yandex Wordstat**, select the specified regions, and fetch **keyword search volume data**.
- The data is extracted **directly from the page source** to **minimize web scraping risks**.
### **5️⃣ Download the Results**
- Once the process is complete, **download** the keyword data as a **CSV file**.
* * * * *
🏗 **Code Structure**
---------------------
📂 **`script.py`** -- Core logic for Selenium automation
- **Browser Setup** -- Configures Chrome for **local or cloud deployment**
- **Login Handling** -- Automates login to Yandex Wordstat
- **Keyword Processing** -- Fetches data for selected regions
- **Timer & Banner Handling** -- Manages UI pop-ups & delays
📂 **`app.py`** -- Streamlit-based UI
- **File Upload** -- Handles Excel file input
- **Real-Time Logging** -- Displays script progress
- **Download Button** -- Provides the CSV download option
* * * * *
📌 **Installation**
-------------------
Run the following commands one after another in your terminal/shell/command line:
### **1️⃣ Clone the Repository and Set Directory**
```
git clone https://github.com/Erzinrost/Yandex-Wordstat.git
```
```
cd Yandex-Wordstat
```
### **2️⃣ Install Dependencies**
```
pip install -r requirements.txt
```
### **3️⃣ Run the Streamlit App**
```
python -m streamlit run app.py
```
* * * * *
📖 **Usage Instructions**
-------------------------
1️⃣ Open **terminal** and run the commands above.\
2️⃣ Upload an **Excel file** containing keywords in **MSK & SPB sheets**.\
3️⃣ Enter your **Yandex login credentials**.\
4️⃣ Select whether the app is running **locally or on Streamlit Cloud**.\
5️⃣ Click **"Start Processing"** to begin fetching keyword data.\
6️⃣ Once completed, **download the results** as a **CSV file**.
* * * * *
🔧 **Requirements**
-------------------
📌 Python **3.8+**\
📌 **Selenium**\
📌 **Streamlit**\
📌 **Pandas**\
📌 **Openpyxl** (for Excel file processing)\
📌 **Webdriver Manager** (for ChromeDriver management)
* * * * *
⚠️ **Potential Issues & Vulnerabilities**
-----------------------------------------
1️⃣ **Yandex UI Changes**
- The script relies on **XPath locators**, which may **change over time**.
- However, alternative locators are included in the code, making updates **straightforward**.
2️⃣ **Frequent Logins & Security Checks**
- Logging into Yandex **too frequently** may trigger **CAPTCHA or push-code verification**.
- **Local execution is recommended**, as **manual input** is possible if needed.
* * * * *
🤝 **Contributing**
-------------------
This project is **not actively maintained** but is updated **as needed**.\
Feel free to **open an issue** or **submit a pull request** for improvements or bug fixes.
* * * * *
📌 **Notes:**
-------------------
- **Cloud deployment is not fully reliable** due to Yandex's security measures and lack of manual control.
- **Local execution is thus recommended** with opened Chrone window automated by Selenium for **better control & stability**.