https://github.com/sapuri/omiai-crawler

A web crawler for Omiai with ChromeDriver
https://github.com/sapuri/omiai-crawler

chromedriver omiai python selenium

Last synced: 8 days ago
JSON representation

A web crawler for Omiai with ChromeDriver

• Host: GitHub
• URL: https://github.com/sapuri/omiai-crawler
• Owner: sapuri
• License: mit
• Created: 2019-06-22T19:38:05.000Z (over 5 years ago)
• Default Branch: master
• Last Pushed: 2024-07-16T05:00:17.000Z (7 months ago)
• Last Synced: 2024-12-10T15:21:02.677Z (2 months ago)
• Topics: chromedriver, omiai, python, selenium
• Language: Python
• Homepage: https://fb.omiai-jp.com/
• Size: 31.3 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE
  • Codeowners: .github/CODEOWNERS

Awesome Lists containing this project

README

        
# Omiai Crawler

A web crawler for Omiai with ChromeDriver

```

$ python crawler.py -h                                                                                                                                                                                                                   14:27:30  ☁  master ☂ ⚡

usage: crawler.py [-h] [-w WIDTH] [-ht HEIGHT] [-t TYPE] [-n PAGE_NUM] [-tmo TIMEOUT] [-hl]

Omiai Crawler: A web crawler for Omiai with ChromeDriver

optional arguments:

  -h, --help            show this help message and exit

  -w WIDTH, --width WIDTH

                        width of the Chrome window

  -ht HEIGHT, --height HEIGHT

                        height of the Chrome window

  -t TYPE, --type TYPE  

  -n PAGE_NUM, --page_num PAGE_NUM

                        number of loading pages

  -tmo TIMEOUT, --timeout TIMEOUT

                        timeout time for waiting for login (sec)

  -hl, --headless       runs Chrome in headless mode

```