Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/omkarcloud/g2-scraper
G2 Scraper helps you collect G2 product data, including names, product descriptions, reviews, ratings, comparisons, alternatives, and more.
https://github.com/omkarcloud/g2-scraper
g2 g2-crowd-scraper g2-data g2-data-scraping g2-dataset g2-dataset-github g2-products g2-products-scraper g2-products-scraping g2-python g2-reviews g2-reviews-github g2-reviews-scraper g2-reviews-scraping g2-scraper g2-scraper-github g2-scraping lead-generation lead-generator leadgeneration
Last synced: 3 days ago
JSON representation
G2 Scraper helps you collect G2 product data, including names, product descriptions, reviews, ratings, comparisons, alternatives, and more.
- Host: GitHub
- URL: https://github.com/omkarcloud/g2-scraper
- Owner: omkarcloud
- License: mit
- Created: 2023-05-15T09:48:46.000Z (over 1 year ago)
- Default Branch: master
- Last Pushed: 2024-08-14T08:56:34.000Z (4 months ago)
- Last Synced: 2024-12-11T17:11:44.567Z (11 days ago)
- Topics: g2, g2-crowd-scraper, g2-data, g2-data-scraping, g2-dataset, g2-dataset-github, g2-products, g2-products-scraper, g2-products-scraping, g2-python, g2-reviews, g2-reviews-github, g2-reviews-scraper, g2-reviews-scraping, g2-scraper, g2-scraper-github, g2-scraping, lead-generation, lead-generator, leadgeneration
- Language: TypeScript
- Homepage: https://www.omkar.cloud/
- Size: 33.8 MB
- Stars: 38
- Watchers: 1
- Forks: 12
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
- Security: SECURITY.md
Awesome Lists containing this project
README
✨ G2 Scraper 🚀
💦 Find G2 Product Details 💦
(Programming Language - Python 3)
---
## Disclaimer for G2 Scraper Project
> By using G2 Scraper, you agree to comply with all applicable local and international laws related to data scraping, copyright, and privacy. The developers of G2 Scraper will not be held liable for any misuse of this software. It is the user's sole responsibility to ensure adherence to all relevant laws regarding data scraping, copyright, and privacy, and to use G2 Scraper in an ethical and legal manner, in line with both local and international regulations.
We take concerns related to the G2 Scraper Project very seriously. If you have any inquiries or issues, please contact Chetan Jain at [[email protected]](mailto:[email protected]). We will take prompt and necessary action in response to your emails.
## 👉 Explore Our Other Awesome Products
- ✅ [Botasaurus](https://github.com/omkarcloud/botasaurus): The All-in-One Web Scraping Framework with Anti-Detection, Parallelization, Asynchronous, and Caching Superpowers.
---
G2 Scraper helps you scrape G2 Products. 🚀
## ⚡ Benefits
1. Absolutely, 0 risk as we offer a generous 90-Day No Question Asked Refund Policy!
2. Easily access G2 results through our user-friendly dashboard by product links or categories, and also get all product reviews.
3. Get 101% accurate, fresh (updated within the last 30 days), and comprehensive data, allowing you to use the results to their full potential.
In just 5 minutes, you'll extract **400+ products** from G2.
## 📦 Requirements
To use this tool, you'll need:
- Node.js version 16 or later to run the UI Dashboard (please check your Node.js version by running `node -v`)
- Python for running the scraper
**Don't have Node.js or Python? No problem!**
You can easily run this tool within Gitpod, a cloud-based development environment, by following [these steps](https://github.com/omkarcloud/g2-scraper/blob/master/advanced.md#-i-dont-have-python-or-im-facing-errors-when-setting-up-the-scraper-on-my-pc-how-to-solve-it).
## 🚀 Getting Started
Let's get started by following these super simple steps:
1️⃣ Clone the Magic 🧙♀️:
```shell
git clone https://github.com/omkarcloud/g2-scraper
cd g2-scraper
```
2️⃣ Install Dependencies 📦:
```shell
python -m pip install -r requirements.txt
python run.py install
```
3️⃣ Launch the UI Dashboard 🚀:
```shell
python run.py
```
4️⃣ Open your browser and go to [http://localhost:3000](http://localhost:3000), then press the Run button to see G2 Products. 😎
*Note: If you don't have Node.js 16+ and Python installed or you are facing errors, follow this Simple FAQ [here](https://github.com/omkarcloud/g2-scraper/blob/master/advanced.md#-i-dont-have-python-or-im-facing-errors-when-setting-up-the-scraper-on-my-pc-how-to-solve-it), and you will have your search results in the next 5 Minutes*
## ⚡ Enlightening Questions
### ❓ How to Get Results for My Queries?
1. Visit [http://localhost:3000](http://localhost:3000) and enter either the
- G2 Category URL (e.g., https://www.g2.com/categories/marketing-automation)
- G2 Product URL (e.g., https://www.g2.com/products/jenkins/reviews)
- G2 Product Slug (e.g., postman)
2. Now, simply press the Run button.
### ❓ What Data Points Are Scraped?
We scrape over 45+ data points, important among them are:
- Name
- Product Description
- Reviews
- Rating
- Category
- Comparisons
- Alternatives
- All Reviews upto 2500
- And many more...
### ❓ How many products, categories, and reviews are there on G2?
- **Products**: Over 170K+ products are listed on G2. You can view the complete list [here](https://raw.githubusercontent.com/omkarcloud/g2-scraper/master/g2/g2-products.json).
- **Categories**: Over 2,051 categories are listed on G2. You can view the complete list [here](https://raw.githubusercontent.com/omkarcloud/g2-scraper/master/g2/g2-categories.json).
- **Reviews**: Over 2.9M+ reviews are listed on G2.
### ❓ Can I see a sample of the scraped data?
You can find sample overviews and reviews of 1000 products below:
- [Overview](https://raw.githubusercontent.com/omkarcloud/g2-scraper/master/g2/samples/overview.csv)
- [Reviews](https://raw.githubusercontent.com/omkarcloud/g2-scraper/master/g2/samples/reviews.csv)
### ❓ How to Scrape More Products?
Kindly follow these steps to use our Rapid API and easily get the g2 product details:
1. Sign up on RapidAPI by visiting [this link](https://rapidapi.com/auth/sign-up).
2. Subscribe to the Free Plan by visiting [this link](https://rapidapi.com/Chetan11dev/api/g2-data-api/pricing).
3. Copy the API key.
4. Put the Key in the "Rapid API Key" textbox and simply run it:
The first 50 products are free to scrape with the API. After that, you can upgrade to the Pro Plan to scrape 4,000 products for $16, and access 101% accurate, fresh, and comprehensive data points with 45+ fields.
### ❓ Do You Offer Discounts for Complete or Partial Datasets?
If you want to:
- Get the complete G2 dataset or 40K+ products
- Get the complete G2 reviews dataset or 400K+ reviews
Please contact us, as
- we offer a 25% discount compared to our API pricing.
- The data will be freshly scraped, and we will deliver the JSON/CSV files of the requested dataset to you within 7 days.
- Absolutely, 0 risk as we offer a generous 90-Day No Question Asked Refund Policy!
Contacting us will only take a few minutes but will save you a lot of time and money.
[](https://api.whatsapp.com/send?phone=918295042963&text=Hi,%20I%20would%20like%20to%20learn%20more%20about%20your%20g2%20scraper)
[](mailto:[email protected])
### ❓ What if I Don't Get Value from It?
We wholeheartedly ❤️ believe in the value our product brings for you, especially since it has successfully worked for hundreds of people like you.
But, we also understand the reservations you might have.
That's why we've put the ball in your court: **If, within the next 90 days, you feel that our product hasn't met your expectations, don't hesitate. Reach out to us, and within 24 hours, we will gladly refund your money, no questions and no hassles.**
The risk is entirely on us! because we're that confident in what we've created!
### ❓ How Do I Get a Refund?
We are ethical and honest, and we will not keep your money if you are not satisfied with our product. Requesting a refund is a simple process that should only take about 5 minutes.
**For API:**
- You need to submit a support request [here](https://support.rapidapi.com/hc/en-us/requests/new), and we will issue the refund.
**For Dataset Purchase:**
- It's even easier to get a refund in case of a dataset purchase. Simply ask for a refund via WhatsApp/Email and provide your PayPal email address. We will issue the complete refund within 24 hours, without any questions and without any hidden charges.
### ❓ This Scraper is Truly One-of-a-Kind, Something I've Never Seen Before. How Did You Build It?
Thank you! We used Botasaurus, which is the secret behind our awesome G2 Scraper.
Botasaurus is a web scraping framework that makes life a lot easier for web scrapers.
It handled the hardest parts of our scraper, such as:
- Creating a gorgeous UI dashboard with task management features
- Sorting, filtering, and exporting data as CSV, JSON, Excel, etc.
- Caching, parallel and asynchronous scraping
If you're a web scraper, I really recommend learning about Botasaurus [here](https://github.com/omkarcloud/botasaurus) 🚀.
Trust me, learning Botasaurus will only take 20 minutes, but I guarantee it will definitely save you thousands of hours in your life as a web scraper.
### ❓ Advanced Questions
Having read this page, you have all the knowledge needed to effectively use the tool.
You may choose to read the following questions based on your interests:
1. [I Don't Have Python, or I'm Facing Errors When Setting Up the Scraper on My PC. How to Solve It?](https://github.com/omkarcloud/g2-scraper/blob/master/advanced.md#-i-dont-have-python-or-im-facing-errors-when-setting-up-the-scraper-on-my-pc-how-to-solve-it)
2. [How to Update the Scraper to the Latest Version?](https://github.com/omkarcloud/g2-scraper/blob/master/advanced.md#-how-to-update-the-scraper-to-the-latest-version)
### ❓ Need More Help or Have Additional Questions?
For further help, feel free to reach out to us through:
- **WhatsApp:** If you prefer WhatsApp, simply send a message [here](https://api.whatsapp.com/send?phone=918295042963&text=Hi,%20I%20would%20like%20to%20learn%20more%20about%20your%20g2%20scraper). Also, to help me provide the best possible answer, please include as much detail as possible.
[](https://api.whatsapp.com/send?phone=918295042963&text=Hi,%20I%20would%20like%20to%20learn%20more%20about%20your%20g2%20scraper)
- **Email:** If you prefer email, kindly send your queries to [[email protected]](mailto:[email protected]). Also, to help me provide the best possible answer, please include as much detail as possible.
[](mailto:[email protected])
We look forward to helping you and will respond to emails and WhatsApp messages within 24 hours.
Good Luck!
## Love It? [Star It ⭐!](https://github.com/omkarcloud/g2-scraper)
Become one of our amazing stargazers by giving us a star ⭐ on GitHub!
It's just one click, but it means the world to me.
[](https://github.com/omkarcloud/g2-scraper/stargazers)
## Made with ❤️ using [Botasaurus Web Scraping Framework](https://github.com/omkarcloud/botasaurus)