Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/omkarcloud/yandex-scraper
Yandex Scraper helps you collect search results from Yandex.
https://github.com/omkarcloud/yandex-scraper
how-to-scrape-data-from-yandex-using-python scrape-yandex serp-api serpapi yandex yandex-api yandex-images yandex-images-crawler yandex-metrika yandex-scraper yandex-scraper-github yandex-scraping yandex-search-api yandex-search-results yandex-search-using-python yandex-serp-api yandex-web-scraping yandex-zen yandexgpt yandexmusic
Last synced: 6 days ago
JSON representation
Yandex Scraper helps you collect search results from Yandex.
- Host: GitHub
- URL: https://github.com/omkarcloud/yandex-scraper
- Owner: omkarcloud
- License: mit
- Created: 2023-12-31T07:15:32.000Z (11 months ago)
- Default Branch: master
- Last Pushed: 2024-01-24T14:48:32.000Z (10 months ago)
- Last Synced: 2024-01-24T15:57:06.015Z (10 months ago)
- Topics: how-to-scrape-data-from-yandex-using-python, scrape-yandex, serp-api, serpapi, yandex, yandex-api, yandex-images, yandex-images-crawler, yandex-metrika, yandex-scraper, yandex-scraper-github, yandex-scraping, yandex-search-api, yandex-search-results, yandex-search-using-python, yandex-serp-api, yandex-web-scraping, yandex-zen, yandexgpt, yandexmusic
- Language: Python
- Homepage: https://www.omkar.cloud/
- Size: 2.45 MB
- Stars: 1
- Watchers: 0
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
✨ Yandex Scraper 🚀
💦 Yandex Scraper helps you collect search results from Yandex. 💦
(Programming Language - Python 3)
---
## Disclaimer for Yandex Scraper Project
> By using Yandex Scraper, you agree to comply with all applicable local and international laws related to data scraping, copyright, and privacy. The developers of Yandex Scraper will not be held liable for any misuse of this software. It is the user's sole responsibility to ensure adherence to all relevant laws regarding data scraping, copyright, and privacy, and to use Yandex Scraper in an ethical and legal manner, in line with both local and international regulations.
We take concerns related to the Yandex Scraper Project very seriously. If you have any inquiries or issues, please contact Chetan Jain at [[email protected]](mailto:[email protected]). We will take prompt and necessary action in response to your emails.
## 👉 Explore Our Other Awesome Products
- ✅ [Botasaurus](https://github.com/omkarcloud/botasaurus): The All-in-One Web Scraping Framework with Anti-Detection, Parallelization, Asynchronous, and Caching Superpowers.
---
Yandex Scraper helps you collect search results from Yandex.
## 🚀 Getting Started
1️⃣ **Clone the Magic 🧙♀:**
```shell
git clone https://github.com/omkarcloud/yandex-scraper
cd yandex-scraper
```
2️⃣ **Install Dependencies 📦:**
```shell
python -m pip install -r requirements.txt
```
3️⃣ **Let the Scraping Begin 😎**:
```shell
python main.py
```
Find your data in the `output` directory.
*Note: If you don't have Python installed. Follow this Simple FAQ [here](https://github.com/omkarcloud/yandex-scraper/blob/master/advanced.md#-i-dont-have-python-installed-how-can-i-run-the-scraper) and you will have your Yandex data in next 5 Minutes*
## 🤔 FAQs
### ❓ How to Scrape Yandex?
1. Open the `main.py` file.
2. Update the `queries` list with the locations you are interested in. For example:
```python
queries = [
"Mango",
"Watermelon",
]
Yandex.search(queries, max=10)
```
3. Run it.
```bash
python main.py
```
Then find your data in the `output` directory.
### ❓ How to Scrape More Yandex Search Results Using Your Yandex API?
To scrape additional data, follow these steps to use our Yandex API. You can make 50 requests for free:
1. Sign up on RapidAPI by visiting [this link](https://rapidapi.com/auth/sign-up).
2. Then, subscribe to our Free Plan by visiting [this link](https://rapidapi.com/Chetan11dev/api/yandex-scraper/pricing).
3. Now, copy the API key.
4. Use it in the scraper as follows:
```python
Yandex.search("Orange", max=10, key="YOUR_API_KEY")
```
5. Run the script, and you'll find your data in the `output` folder.
```bash
python main.py
```
The first 50 requests are free. After that, you can upgrade to the Pro Plan, which will get you 1000 requests for just $9.
### ❓ How did you build it?
We used Botasaurus, It's an All-in-One Web Scraping Framework with Anti-Detection, Parallelization, Asynchronous, and Caching Superpowers.
Botasaurus helped us cut down the development time by 50% and helped us focus only on the core extraction logic of the scraper.
If you are a Web Scraper, you should learn about Botasaurus [here](https://github.com/omkarcloud/botasaurus), because Botasaurus will save you countless hours in your life as a Web Scraper.
### ❓ Need More Help or Have Additional Questions?
For further help, contact us on WhatsApp. We'll be happy to help you out.
[](https://api.whatsapp.com/send?phone=918295042963&text=Hi,%20I%20would%20like%20to%20learn%20more%20about%20your%20products.)
## Love It? [Star It! ⭐](https://github.com/omkarcloud/yandex-scraper/stargazers)
## Made with ❤️ using [Botasaurus Web Scraping Framework](https://github.com/omkarcloud/botasaurus)