https://github.com/DanMcInerney/search-google

Scrape google search results
https://github.com/DanMcInerney/search-google

Last synced: about 2 months ago
JSON representation

Scrape google search results

• Host: GitHub
• URL: https://github.com/DanMcInerney/search-google
• Owner: DanMcInerney
• License: apache-2.0
• Created: 2014-10-05T01:14:24.000Z (almost 10 years ago)
• Default Branch: master
• Last Pushed: 2018-08-24T14:30:08.000Z (about 6 years ago)
• Last Synced: 2024-05-21T00:49:40.567Z (4 months ago)
• Language: Python
• Size: 11.7 KB
• Stars: 91
• Watchers: 6
• Forks: 32
• Open Issues: 4
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
search-google

=============

Scrape Google search results with Selenium. No obfuscation other than random Firefox user-agents, just a simple scraper that returns however many pages of results you want. 1 page = 100 results. 

Dependencies

-------

* python 2.7

* Selenium

Installation

-------

```shell

pip install --user selenium

git clone https://github.com/DanMcInerney/search-google

cd search-google

```

Usage

-----

```shell

python search-google.py -p 3 -s '"Dan McInerney"'

```

Will open an instance of Firefox and search 3 pages of 100 results each for "Dan McInerney" (quotes included) in Google then print the title and url of each result.