https://github.com/leafney/ubuntu-spiderenv-py2
The environment in Docker for spider to get static or dynamic web pages html and analytic it.
https://github.com/leafney/ubuntu-spiderenv-py2
Last synced: 4 months ago
JSON representation
The environment in Docker for spider to get static or dynamic web pages html and analytic it.
- Host: GitHub
- URL: https://github.com/leafney/ubuntu-spiderenv-py2
- Owner: leafney
- Created: 2017-03-01T16:27:05.000Z (over 8 years ago)
- Default Branch: master
- Last Pushed: 2017-03-02T10:46:38.000Z (over 8 years ago)
- Last Synced: 2025-01-14T15:23:40.796Z (5 months ago)
- Language: Shell
- Size: 23.4 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
### Ubuntu-SpiderEnv-Py2
The environment in Docker for spider to get static or dynamic web pages html and analytic it.
#### Support
* requests
* selenium + phantomjs
* selenium + firefox
* selenium + chrome
* BeautifulSoup4
* lxml
* Scrapy