https://github.com/gesiscss/webbot-tutorials

Basic parsing capabilities for search engine results scraped with WebBot
https://github.com/gesiscss/webbot-tutorials

Last synced: about 1 year ago
JSON representation

Basic parsing capabilities for search engine results scraped with WebBot

• Host: GitHub
• URL: https://github.com/gesiscss/webbot-tutorials
• Owner: gesiscss
• License: mit
• Created: 2023-03-08T09:37:06.000Z (over 3 years ago)
• Default Branch: main
• Last Pushed: 2023-09-25T14:14:59.000Z (almost 3 years ago)
• Last Synced: 2025-04-19T19:05:17.029Z (over 1 year ago)
• Language: Jupyter Notebook
• Homepage:
• Size: 4.29 MB
• Stars: 6
• Watchers: 8
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# WebBot tutorials

[![Binder](https://mybinder.org/badge_logo.svg)](https://mybinder.org/v2/gh/gesiscss/WebBot-tutorials/HEAD)

This repository contains tutorials for parsing search engine results scraped with [WebBot](https://github.com/gesiscss/WebBot).

## Parsing with Python

You can parse search result pages saved from Google, DuckDuckGo, etc. using our Python package [WebBotParser](https://github.com/gesiscss/WebBotParser) for further analysis.

To install it, use `pip`:

```

pip install git+https://github.com/gesiscss/WebBotParser

```

For examplary usage, see [example.ipynb](./example.ipynb).

## Parsing with R

Refer to [webbotparseR](https://github.com/schochastics/webbotparseR), a similar R package.

## Alternative

[WebSearcher](https://github.com/gitronald/WebSearcher) is a Python package that facilitates obtaining and parsing search results from Google text search. Compared to `webbotparser`, it supports parsing more diverse results (ads, knowledge boxes, etc.), but only Google text results (for now). [websearcher.ipynb](./websearcher.ipynb) illustrates how to utilize WebSearcher's parsing capabilities on search result pages obtained using WebBot.